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OPTIMAL  CONTROL  OF  SYSTEMS  WITH  UNCERTAINTY 


I .  Introduction 

In  Attempting  to  design  a  controller  which  optimally  steers  a  system 
to  a  prescribed  target,  two  basic  problems  arise.  The  first  is  to  determine 
If  there  exists  a  control  which  steers  the  system  to  the  target.  Since 
we  are  investigating  systems  with  disturbances,  the  control  must  steer 
the  system  to  the  target  for  all  possible  disturbances.  If  at  least 
one  such  control  exists,  the  second  problem  is  to  find  the  optimal  one. 

The  research  being  conducted  under  AFOSR  Grant  76-2923  is  concerned  with 
obtaining  techniques  for  solving  these  problems.  It  is  believed  that 
these  techniques  will  aid  in  the  design  of  controllers  for  uncertain 
systems.  In  our  approach,  the  only  assumption  about  the  disturbance 
is  that  it  belongs  to  a  compact  set.  Thus,  the  application  of  this 
research  does  not  require  any  assumption  about  the  statistics  of  the 
disturbance  and  will  offer  an  alternative  design  scheme  to  those  schemes 
which  Involve  stochastic  processes. 

II .  Results  Obtained 

Before  considering  the  difficult  problem  of  controlling  a  system 
with  disturbances  to  a  general  target,  it  was  deemed  necessary  to  first 
consider  some  simpler  problems.  Most  controllability  results  assume 
there  are  no  constraints  on  the  magnitude  of  the  controls.  This  is 
usually  unrealistic,  since  physical  limitations  do  place  constraints  on 
the  instantaneous  control  values. 

The  first  problem  considered  was  that  of  steering  a  system  without 
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disturbances  to  the  origin  when  the  magnitude  of  the  control  is  constrained. 
A  technique  was  developed  for  determining  if  a  system  can  be  steered  to 
the  origin  and  also  a  method  for  obtaining  such  a  control  when  it  exists. 
These  results  have  been  submitted  to  the  S.I.A.M.  Journal  on  Control  and 
Optimization  and  are  contained  in  Appendix  A. 

Next,  the  controllability  problem  was  generalized  by  allowing  for 
targets  other  than  the  origin.  Similar  results  were  obtained  for  this 
problem.  The  specific  details  are  reported  in  Appendix  B  and  a  paper 
has  been  submitted  to  IEEE  Transactions  on  Automatic  Control.  These 
results  were  also  discussed  in  two  talks  at  a  conference  in  Montreal. 

The  sumnaries  of  these  talks,  which  appeared  in  the  conference  proceedings, 
are  Included  in  Appendix  C. 

In  some  situations,  the  target  Is  a  linear  combination  of  the  state 
variables  (affine  target).  The  results  discussed  in  Appendix  B  can  be 
applied  to  these  problems  and  lead  to  an  n  dimensional  finite  optimization 
problem.  To  reduce  computational  complexity, a  method  was  developed  which 
exploits  the  affine  nature  of  the  target  and  requires  the  solution  of  a 
smaller  dimensional  optimization  problem.  The  computational  benefits  of 
this  approach  can  be  significant.  These  results  were  presented  at  the 
1979  Joint  Automatic  Control  Conference.  Appendix  D  contains  a  copy  of 
the  paper  which  appeared  in  the  proceedings  of  that  conference. 

With  these  results  now  established,  we  have  been  able  to  make  some 
progress  on  problems  where  uncertainty  is  present.  More  details  of  this 
are  given  in  the  next  section. 

One  other  area  which  has  been  under  investigation  is  that  of 


avoidance  concrol.  The  problem  is  co  determine  if  there  exists  a  control, 
satisfying  the  constraints,  which  steer  a  system  so  as  to  avoid  a  specified 
target.  Some  results  have  been  obtained  and  a  manuscript  on  this  problem 
is  being  prepared  for  submission  for  presentation  at  the  1980  Joint 
Automatic  Control  Conference. 

Ill .  Research  in  Progress 

The  theory  for  constrained  controllability  problems  without  disturbances 
is  now  fairly  well  developed.  Using  the  results  and  insights  obtained 
for  these  problems,  we  are  currently  investigating  the  controllability 
problem  for  systems  with  disturbances.  Methods  for  determining  if  there 
exists  a  control  which  steers  a  system,  subject  to  disturbances,  to  a 
target  have  been  obtained.  This  research  has  been  done  in  conjunction  with 
Bruce  Elenbogen,  a  graduate  student  in  Applied  Mathematics  who  is  being 
supported  by  the  grant.  He  is  now  writing  <  these  results  as  part  of  his 
Ph.D.  thesis. 

Research  is  also  continuing  on  controllability  of  systems  without 
disturbances.  We  are  attempting  to  determine  methods  for  finding  the 
largest  set  of  initial  states  which  can  be  steered  to  the  target  in  a 
specified  time  Interval.  If  we  are  successful  in  this  endeavor,  the 
techniques  will  be  extended  to  systems  with  disturbances. 

Work  is  also  in  progress  on  the  avoidance  control  problem  as  well 


as  the  closely  related  holding  problem.  The  holding  problem  is  the  problem 
of  determining  if  there  exists  a  control  which  keeps  or  holds  a  system 
in  a  prespecified  region.  We  have  shown  that  the  results  which  apply  to 
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the  avoidance  problem  can  also  be  used  Co  solve  the  holding  problem. 

Methods  for  obtaining  avoidance  (and  holding  controls)  are  currently 
under  development. 

IV.  Additional  Information 

Papers  resulting  from  the  research  sponsored  bv  AFOSR  under  Grant 
AFOSR  76-2923. 

1.  Static  Multlcrlcerla  Problems:  Necessary  Conditions  and  Sufficient 
Conditions,  Proceedings  IFAC  Symposium  on  Large  Scale  Systems.  Udine, 
Italy,  June  16-20,  1976. 

2.  A  Sufficient  Condition  for  Mlnmax  Control  of  Systems  with  Uncertainty 
In  the  State  Equations,  IEEE  Trans.  Auto.  Control.  Vol.  AC-21,  No.  4, 
August  1976.  (Also  in  Proceedings  1976  JACC .  Lafayette,  Indiana). 

3.  Necessary  Conditions  and  Sufficient  Conditions  for  Static  Mlnmax 
Problems,  J.  Math.  Anal.  Appllc..  Vol.  57,  No.  2,  February  1977. 

4.  Mlnmax  Control  of  Systems  with  Uncertainty  in  the  Initial  State  and 

in  the  State  Equations,  IEEE  Trans.  Auto.  Control.  Vol.  AC-22,  No.  2, 
April  1977  (Also  in  Proceedings  1976  Conference  on  Decision  and  Control. 
Clearwater  Beach,  Florida).  | 

5.  A  Note  on  the  Use  of  the  Direct  Sufficient  Conditions  In  Optimal 

j 

Control  Problems,  J.  of  Optimization  Theory  and  Appllc,.  Vol.  23, 

No.  3,  Nov.  1977. 

6.  Profit  Maximization  Through  Advertising:  A  Nonzero  Sum  Differential 
Game  Approach  (with  G.  Leltmann) ,  IEEE  Trans.  Auto.  Control.  Vol. 


AC-23,  No.  4,  August  1978. 
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7.  Optimal  Control  of  the  End-Temperature  in  a  Semi-Infinite  Rod  (with 
W.  E.  Olmstead),  Zeltachrift  fur  angewandte  Mathematlk  und  Physik. 

Vol .  28,  pp.  697-706,  1977. 

8.  Multicriteria  Optimization  With  Uncertainty  in  the  Dynamics,  Proceedings 
1977  Allerton  Conference  on  Communication,  Control  and  Computing. 
Monticello,  Illinois,  Sept.  28-30,  1977, 

9.  Optimal  Blowing  (with  W.  E.  Olmstead),  SIAM  J.  Applied  Math.  Vol. 

35,  No.  3,  November  1978. 

10.  A  Necessary  and  Sufficient  Condition  for  Local  Constrained  Controllability 
of  a  Linear  System  (wich  B.  R.  Barmish),  Proc.  1978  Allerton 
Conference  on  Consnunieation,  Control  and  Computing.  Monticello, 

Illinois,  Oct.  4-6,  1978* 

11.  Optimal  Control  of  Systems  with  Multiple  Criteria  When  Disturbances 
are  Present,  J,  of  Optimization  Theory  and  Applications.  Vol.  27,  No. 

I,  Jan.  1979. 

12.  Constrained  Controllability  (with  B.  R.  Barmish),  Proc.  17th  IEEE 
Conference  on  Decision  and  Control.  San  Diego,  Calif.,  Jan.  10-12,  1979. 

13.  A  General  Sufficiency  Theorem  for  Mlnmax  Control,  J.  of  Optimization 
Theory  and  Applications,  Vol.  27,  No.  3,  March  1979. 

14.  A  Simple  Derivation  of  Necessary  Conditions  for  Static  Minmax  Problems, 

J.  Math,  Analysts  and  Appllc..  Vol.  70,  No.  2,  August  1979. 

15.  A  Necessary  and  Sufficient  Condition  for  Local  Constrained  Controllability 
of  a  Linear  System  (with  B.  R.  Barmish),  IEEE  Transactions  on  Automatic 
Control .  Vol.  AC-25,  No.  1,  Feb.  1980. 

16.  Controlling  a  System  to  a  Target  -  Part  I;  Linear  Systems  with  Origin 
as  Target  (with  B.  R.  Barmish),  Proceedings  of  Optimization  Days  1979. 


McGill  University,  Montreal,  Canada,  May  1979. 

17.  Controlling  a  System  to  a  Target  -  Part  II:  Nonlinear  Systems  with  a 
General  Target  (with  B.  R.  Barmish) ,  Proceedings  of  Optimization 
Days  1979.  McGill  University,  Montreal,  Canada,  May  1979. 

18.  A  Result  on  Controlling  a  Constrained  Linear  System  to  a  Linear 
Subspace  (with  B.  R.  Barmish),  Proceedings  1979  J.A.C.C..  Denver, 
Colorado,  June  1979. 

19.  Null  Controllability  of  Linear  Systems  with  Constrained  Controls 
(with  B.  R.  Barmish),  SIAM  J.  on  Control  and  Optimization  (submitted). 

20.  New  Results  on  Controllability  of  Systems  of  the  Form  x(t)  ■ 

A(t)x(t)  f(t,u(t))  (with  B.  R.  3armish),  IEEE  Transactions  in 

Automatic  Control  (submitted). 

Conferences  and  Lectures  (Sept.  1978  -  August  1979) 

I  presented  a  paper  on  local  controllability  at  the  1978  Allerton 
Conference  on  Cocsnunlcation,  Control  and  Computing,  Monticello,  Illinois, 
Oct.  1978. 

I  presented  an  invited  lecture  on  the  optimal  control  of  systems  with 
uncertainty  at  the  University  of  Rochester,  November,  1978. 

1  presented  a  paper  on  constrained  controllability  at  the  17th  IEEE 
'  Conference  on  Decision  and  Control,  San  Diego,  Calif.,  Jan.  1979. 

I  presented  two  papers  on  controlling  a  system  to  a  target  at 
Optimization  Days  1979,  Montreal,  Canada,  May  1979. 

1  presented  a  paper  on  controlling  a  system  to  a  linear  subspace  at 
the  1979  J.A.C.C.,  Denver,  Colorado,  June  1979. 


NULL  CONTROLLABILITY  OF  LINEAR  SYSTEMS  WITH  CONSTRAINED  CONTROLS 


W.  E.  SCHMITENDORF*  and  B.  R.  BARMISH** 


Abstract .  The  paper  considers  the  problem  of  steering  the  scate  of  a  linear 
time-varying  system  to  the  origin  when  the  control  is  subject  to  magnitude 
constraints.  Necessary  and  sufficient  conditions  are  given  for  global  con¬ 
strained  controllability  as  well  as  a  necessary  and  sufficient  condition  for 
the  existence  of  a  control  (satisfying  the  constraints)  which  steers  the  system 

to  the  origin  from  a  specified  initial  epoch  (x  ,t  ).  The  global  result  does 

o  o 

not  require  zero  to  be  an  interior  point  of  the  control  set  fl  and  the  theorem 
for  constrained  controllability  at  (*0*c0)  only  requires  that  0  be  compact, 
not  that  it  contain  zero.  The  results  are  compared  to  those  available  in  the 
literature.  Furthermore,  numerical  aspects  of  the  problem  are  discussed  as 
is  a  technique  for  determining  a  steering  control. 


* 
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Introduction  and  Formulation.  Consider  the  problem  of  steering  the 


state  of  a  linear  system 

(S)  *(t)  -  A(t)x(t)  ♦  B(t)u(t) ;  t  €  [tQ,«) 

to  the  origin  from  a  specified  Initial  condition 

x(t  )  -  x 
o  o 

by  choice  of  control  function  u(*).  Here  x(t)  €  R°,  u(t)  €  Rm  and  A(‘)  and  B(-) 

♦ 

are  continuous  matrices  of  appropriate  dimension.  Unlike  the  usual  controll¬ 
ability  problem  where  the  control  values  at  each  instant  of  time  are  uncon¬ 
strained,  we  insist  here  that  the  control  values  at  each  instant  of  time  belong 
to  a  prespecified  set  fl  in  Rm. 

Let  (fl)  denote  the  set  of  functions  from  R  into  Ti  that  are  measurable  on 
^t^,®).  Then  any  control  u(*)  €  T,  (T.)  is  termed  admissible.  We  now  define 
three  notions  of  constrained  controllability  or,  more  precisely,  T.-null  controll¬ 
ability. 

Definition  1.1.  The  linear  svstem  (S)  is  T.-null  controllable  at  (x  ,t  ) 

1  ■■■'-  —  ■  1  .  —  o  o 

if,  given  the  initial  condition  x(tQl  ■  x^,  there  exists  a  control  u(*)  €T.(fl) 

such  Chat  the  solution  x(-)  of  (S)  satisfies  x(c)  -  0  for  some  t  6  rt  ,*). 

o 

Definition  1.2.  The  linear  svstem  (S)  is  global ly  f.-nul 1  controllable 
at  t  if  (S)  is  r.-null  controllable  at  (x  ,t  )  for  all  x  €  Rn. 

—  O  0  0  0 

Our  major  result  will  pertain  to  the  global  type  of  controllability.  To 
compare  our  results  to  those  of  previous  researchers,  we  also  need  a  local  con¬ 
trollability  conceot. 

Definition  1.3.  The  linear  system  (S)  is  locally  r<-nul 1  controllable  at 

t^  if  there  exists  an  open  set  V  C  Rn,  containing  the  origin,  such  that  (S) 

is  null  controllable  at  (x  ,t  )  for  all  x  €  V. 

o  o  o 

♦ 

This  requirement  can  be  weakened  to  local  lntegrabllity . 
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The  majority  of  constrained  controllability  results  are  for  autonomous 

m  •  • 

systems,  i.e.,  systems  where  A  and  B  are  constant.  When  P,  •  R  ,  Kalman  [lw 
showed  that  a  necessary  and  sufficient  cond'*ion  for  global  Rm-null  controll¬ 
ability  is  rank(Q)  •  n  where  Q  *  Tb.AB . A°  *B^.  Lee  and  Markus  [2]  con¬ 

sidered  constraint  sets  ."1  -  Ra  which  contain  u  ■  0  and  showed  that  rank(Q)  •  n 
is  a  necessary  and  sufficient  condition  for  (S)  to  be  locally  Pi-null  controllable. 
Furthermore,  if  each  eigenvalue  X  of  A  satisfies  Re(X)  <  0,  then  (S)  is  globally 
T.-null  controllable.  This  result  is  typical  of  the  results  available  when  Pi 
contains  the  origin. 

Saperstone  and  Yorke  ^3^  were  the  first  to  eliminate  the  assumption  that 
zero  is  an  interior  point  of  Pi  when  they  considered  problems  with  m  -  1  and 
Q  ■  ^0,1*.  Their  result  states  that  for  these  problems  (S)  is  locally  fl-null 
controllable  if  and  only  if  rank(Q)  ■  n  and  A  has  no  real  eigenvalues.  They 
also  extend  this  result  to  a  >  1  and  consider  the  m-fold  product  set  ..  ■  7.^0, 14. 
Problems  with  more  general  constraint  sets  were  studied  by  Brarmner  £4*  who 
showed  that  if  there  exists  a  u  €  Cl  satisfying  Bu  -  0  and  the  convex  hull  of  Pi 
has  a  nonempty  Interior,  then  necessary  and  sufficient  conditions  for  local 
0-null  controllability  are  rank(Q)  ■  n  and  the  nonexistence  of  a  real  eigen¬ 
vector  v  of  A*  satisfying  v’Bu  i  0  for  all  u  (1  In  addition,  if  no  eigen¬ 
value  of  A  has  a  positive  real  part  then  the  theorem  becomes  one  for  global 
,'1-null  controllability.  A  similar  result  for  global  controllability  when 
Pi  ■  ^0,1*  was  obtained  by  Saperstone  ^52-  Friedman  [6]  considers  a  linear 
pursuit  evasion  problem  where  the  target  is  a  closed  convex  set  and  gives  a 
sufficient  condition  for  the  existence  of  a  pursuer  control,  based  on  the 
evader's  control,  which  drives  the  system  from  a  specified  initial  condition 
to  the  target. 

For  nonautonomous  system*,  the  most  familiar  controllability  result  is  that 
of  Kalman  rl]  when  P.  •  R®.  He  showed  that  (S)  is  Rm-nuli  controllable  if  and 
only  if  W(to,t1)  is  positive  definite  for  some  tj  €  [tQ,<»)  where 
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W(t  ,t  )  &  3(C,  ,t)B(t)B’(t)0’(c,  ,T)dr 

O  L  V  ^  L  1 

O 

and  2(t,T)  is  Che  state  transition  matrix  tor  (S).  When  the  control  is  con¬ 
strained,  the  major  global  results  are  those  by  Conti  [7^  and  Pandolfl  r8l.  In 
'7',  Conti  describes  a  "divergent  integral  condition"  which  is  necessary  and 
sufficient  for  global  ft- null  controllability  when  ft  is  the  closed  unit  ball.  In 
order  to  make  Conti's  result  more  compatible  with  existing  theory  for  time- 
invariant  systems,  Pandolfi  in  [8[  defines  the  notion  of  p-th  characteristic 
exponent  for  time  varying  systems.  For  the  special  case  when  the  system  is  time- 
invariant,  the  characteristic  exponent  turns  out  to  be  the  real  part  of  some 
eigenvalue  of  A.  Subsequently,  controllability  criteria  are  provided  in  terms 
of  this  exponent. 

The  ft-null  controllability  problem  is  also  studied  in  papers  by  Dauer  [9l, 
rl0:,  Chukvu  and  Crons ki  [ll[  and  Chukwu  and  Silltman  ^123-  In  order  to  decide 
on  the  question  of  ft-con trol lab il i tv, one  must  test  a  certain  growth  condition 
which  involves  searching  a  function  space.  In  contrast,  the  results  given  here 
are  finite-dimensional  in  nature. 

In  "13',,  Grantham  and  Vincent  consider  the  problem  of  steering  a  nonlinear 
system  to  a  target.  They  present  a  technique  for  determining  the  boundary  between 
the  set  of  states  which  can  be  steered  to  the  target  and  those  which  cannot. 

More  recently,  Murthy  and  Evans  [l&[  obtained  results  comparable  to  [32-[5„  for 
discrete  linear  systems  and  Pachter  and  Jacobson  [15*  developed  sufficient  con¬ 
ditions  for  controllability  for  case  where  A(*)  and  B(*)  are  time-invariant  and 
ft  is  a  closed  convex  cone  containing  the  origin.  A  readable  account  of  the 
state  of  the  art  is  contained  in  the  book  by  Jacobson  [16,  Chapter  5j. 

In  contrast  to  much  of  the  work  of  previous  authors,  this  paper  concentrates 
on  the  case  where  A(*)  and  B(*)  are  time-varying.  Our  results  for  global  ft-null 
controllability  are  for  constraint  sets  ft  that  are  compact  and  contain  zero 
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(2.2) 


•  6  - 


We  note  that  J(x  ,T,\)  can  be  viewed  as  the  support  function  on  the  so-called 
o 

attainable  sec.  This  fact  is  used  Implicitly  in  the  proof  of  the  next  theorem. 

Theorem  2.3.  Let  H  be  a  compact  set .  Pick  any  subset  A  o£  R°  which  contains 

0  as  an  interior  point.  Then  (S)  is  fi-null  controllable  at  (x  ,t  )  if  and  onlv  if 

—  —  *-  — —  —  ■  "  —  O  O  ~ 

(2.3)  ain[j(xo,T,X)  :  X  €  A}  ■  0 

for  some  T  €  [t^,*) ,  or  equivalently,  if  and  onlv  i f . 

(2.4)  J(xq,T,X)  2  0  for  all  X€A 

for  some  T  €  r t  ,") . 

—  ■  -  “  o 

Consnent .  If  f*  is  also  convex  and  A  and  3  are  constant,  the  sufficiency 
portion  of  this  theorem  is  just  a  special  case  of  Theorem  7.2.1  of  [ft]. 

Naturally,  the  smallest  time  T  for  which  (2.3)  holds  will  be  the  minimum  arrival 
time  at  the  origin. 

Theorem  2.3  can  also  be  stated  in  terms  of  the  adjoint  system  (S'),  i.e., 

if  we  take  A  ■  R°  and  notice  that  z(t)  •  2'(t  ,t)z(t  )  is  the  response  of  the 

o  o 

adj  olnt  system  (S'),  then  the  following  theorem  is  easily  proven.  (The  proof  is 
established  by  making  the  change  of  variables  z(t)  ^  ®'(T,t)X). 

Theorem  2.3'.  Let  f.  sat  is  fy  the  hypothesis  of  Theorem  2.3.  Then  (S)  is 
fi-null  controllab le  at  (x^.t^)  _i_f  and  only  if  there  exists  some  T  €  [tQ,«)  such 
that 


(2.5) 


x’z(t  )  + 
o  o 


lU(B’(T)z(T))dT  S  0 


o 


for  all  solutions  z(»)  of  (S’). 

This  theorem  demonstrates  that  the  question  of  fl-null  controllability  at 
(xo,tQ)  can  be  answered  by  solving  a  finite  dimensional  optimization  problem. 
Moreover,  the  question  of  global  fi-null  controllability  can  also  be  answered 
via  a  finite  dimensional  optimization  problem. 


Corollary  2.4.  Let  0  and  A  b<i  a£  ^n  Theorem  2.3.  Then  (S )  J_s  globally 


0-null  controllable  jit  t^  and  only  If  for  every  x^  €  Rn  there  la  a  time 

T  €  [t  ,»)  such  that 

o 


min{ J (x  ,T  ,X)  :  X  €  A}  ■  0  . 

o 


The  proof  of  this  corollary  follows  from  Theorem  2.3  In  conjunction  with 


the  definition  of  global  O-null  controllability. 


There  Is  one  point  worth  noting.  In  using  Theorem  2.1  to  check  for  O-null 


controllability  at  tQ,  0  must  be  compact  and  contain  0.  If  Corollary  2.4  is 
used,  only  the  compactness  assumption  must  be  satisfied. 


Next,  we  present  some  examples  to  illustrate  how  our  theorems  can  be 


applied  and  to  compare  our  results  to  those  of  [3-5]. 


Example  1.  Let  x(t)  and  u(t)  be  scalars  and  suppose  (S)  Is  described  by 
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and  thus 


mlntJ(xo,T,\)  :  V  €  r-l,l]3  -  0 

-T 

if  and  only  if  x^  <  0  and  2  e  -  1  for  some  T  6  [0,»),  or  equivalently,  if 

and  only  if  -1  <  xq  i  0.  We  conclude  that  even  though  (S)  is  not  locally  Q-null 

controllable,  it  is  Q-null  controllable  at  (x  ,0)  whenever  -1  <  x  <0. 

o  o 

If  Cl  ■  r 1 , 23 *  neither  [3-5]  nor  Theorem  2.1  apply.  However,  we  can  use 
Theorem  2.3.  Since 


X  >  0 

X  <  0 


min(j(xo,T,X)  :  X  €  [-1,01  *  0 

if  and  only  if  2(e  1)  4  x  4  e  1.  Thus  (S)*with  Cl  •  rl,2*»is  Il-null  con- 

,  o 

trollable  at  (x  ,0)  whenever  -2  <  x  <0. 

o  o 

As  a  final  variation  of  this  prob  lets,  suppose  Ti  ■  [-a, a].  Then  [4]  or 
Theorem  2.1,  shows  that  (S)  is  not  globally  Onull  controllable.  Using  [O, 


it  can  be  demonstrated  that  (S)  is  locally  fi-null  controllable  while  Theorem  2.3 


not  only  tells  us  that  (S)  is  locally  fl-null  controllable  but  also  that  the  states 

x  which  can  be  steered  to  the  origin  are  those  satisfying  -a  <  x  <  a. 
o  O 

Example  2.  Our  second  example  Illustrates  the  application  of  Theorem  2.1 
for  a  nonautonomous  system.  We  consider  the  time-varying  two-dimens ional  system 
(S)  described  by 
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*^(t)  -  u(e)slnt 


*2(t) 


1 


"J  x^(£)  +  u(t)tsint,  t  €  rot.) 


(t+l)‘ 

The  control  constraint  set  Is  taken  to  be  fl  •  [0,lj.  By  a  straightforward  com¬ 
putation,  the  state  transition  matrix  for  the  adjoint  system  (S')  is  found  to  be 

t  -  t 


l 


(t+l)(to+i) 


Hence,  in  accordance  with  Theorem  2.1,  (S)  is  globally  fl-null  controllable  at 


t  ■  0  if  and  only  if 
o 


sup  tiiTs  in  t  rs  in  t  Z 
*o  «€[0,l] 


1  t+1  I  l20l 


:  dr  •  + 

,>2  J 


for  all  non-ce’-o  initial  conditions  z^  ^  ^zQ1  zo2**‘  Evaluating  above,  this 


reduces  to  the  requirement  that 


(2.6) 


K  *'  f  1  ^ 

I(t  )dr  *  max  •  O.z^  sin  r  +  Zq2  t  sin  t (1  +  ^j)  *  dr  ■  ♦  • 

o  '  o 


for  all  Zq  *  0.  We  shall  show  that  this  condition  is  indeed  satisfied. 
Case  1 .  zQ1  ^  0,  z ^  ■  0.  For  this  case,  we  have 


r, 


(t  )dr  -  max{0,  zQ1  sin  tldt 


Z01  ,ln  T  * 


*3, 


where  3^  ■  (t  i  0:  z^  sin  t  >  0) .  Because  the  range  set  3  ^  of  integration  is 
the  union  of  infinitely  many  intervals  of  length  n,  it  follows  that 


!  I(t  )dr  •  +  • 
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Case  2.  •  anything,  zQ2  4  0. 

(2.6),  it  sufflcies  to  show  that 


Let  T 


I'oil  +  1 


Then  to  verify 


I(t  )<Jt  -  +  * 

0  2 

where  "  (T  2  T  :  *q2  sin  t  >  0).  (Recall  that  the  integrand  is  non-negative.) 
Now,  for  r  €  ^2,  we  notice  that  the  integrand  I(t)  can  be  bounded  froai  below  as 
follows : 


T  + 


Z02t 


sln  T(l  +  a  U02,,sln  T,T(l  +  TTi)  *  ,2oi>,#ln  T' 


2 


2 


T  -  Z 


or  /' 


1  -'*«,!  I 


s  in  t  I 
s  in  t  ' 


■  1  s in  r  I 


Hence , 

r  r  . 

I(r)dT  2  !  s  in  r  dr  ■  ® 

°  2  °2 

because  the  range  of  Integration  is  once  again  the  union  of  infinitely  many 
Intervals  of  lengths. 

We  conclude  that  (S)  is  globally  fi-null  controllable. 


3.  Relationship  with  Other  Controllability  Results.  In  this  section,  we 
compare  our  controllability  results  with  those  of  Conti  [7]  and  Braaner  [4],  We 
also  consider,  as  a  limiting  case  of  our  theory,  the  usual  controllability  problem 
obtained  when  magnitude  constraints  are  not  present. 

Result  of  Conti.  An  important  special  case  of  Theorem  2.1  occurs  when  f)  is 
a  closed  unit  ball  In  R™,  l.e., 

0  ■  {«  €  Rm  :  >i»|!  <  H 

where  !|  ,!l  is  a  prespecified  norm  on  Rm.  For  this  situation  we  have 
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(U(B’(t)z(t))  -  sup{>’B' (t)z(t  )  :  Ijujl  *  1]  -  ||  B ' (t  )z  (t  )||  * 

where  \  is  the  norm  on  Rm  which  is  dual  to  !!  .||  .  (For  example  ||  »||  is  the 

il  norm  when  '!  -  !  is  the  2*  norm;  "  •!!  and  ::  »|  *  coincide  when  j|  *||  is  the  usual 

2 

2  (Euclidean)  norm.) 

By  Theorem  2.1,  we  conclude  that  (S)  is  globally  D-null  controllable  at 

t  if  and  only  if 
o 


(3.1) 


B ' (t  )z(t  )'!  .dT  -  « 


for  all  non-zero  solutions  z(-)  of  (S').  This  result  is  established  indepen¬ 
dently  in  Conti  [7^  and  also  discussed  in  Pandolfi  [8^.  This  result,  in  con¬ 
junction  with  Corollary  2.2  leads  immediately  to  the  following  Proposition. 

Propos it  ion  3.1.  Let  T.  be  any  set  containing  zero  in  its  interior.  Then 
(3.1)  h  «  necessary  and  sufficient  condition  for  global  f.-null  controllability. 

Thus,  Conti's  condition  is  a  necessary  and  sufficient  condition  for  global 
D-null  controllability  for  any  set  D  containing  zero  in  its  interior,  not  Just 
when  D  is  the  closed  unit  ball. 

Result  of  3ran«ner.  Consider  the  case  when  A(t)  ■  A  and  B(t)  ■  B  are  time- 
invariant.  For  these  autonomous  problems,  the  following  necessary  conditions 
can  be  obtained  directly  from  Theorem  2.1.  Recall  that  Q  ■  [B,AB, . A°  *Bj. 

Theorem  3.2.  Assume  A(t)  »  A  and  3(t)  ■  B  are  t lme- invar lant  and  that 
f)  _i£  a  compact  set  which  contains  the  origin .  If  (S)  _i_s  global ly  fl- nu  1 1  con¬ 
trollable  then 
(1)  rank  (Q)  -  n 

( i i )  there  is  no  real  eigenvector  v  <of  A '  satisfying  v ' Bin  <  0  for  all  «u  €  . 

(ill)  no  eigenvalue  of  A  has  a  positive  real  part. 


The  proof  of  this  result  is  in  Appendix  B. 


-  12  - 

In  [4],  Braraner  has  obtained  the  same  result  using  a  different  method  of 
proof.  There,  he  also  shows  that  the  above  three  conditions  are  also  sufficient 
for  global  .~-null  controllability  in  the  time  Invariant  case  if  it  is  also 
assumed  that  the  convex  hull  of  ft  has  a  non-empcy  interior.  Alternative  proofs 
of  the  sufficiency  result  have  been  given  by  Heymann  and  Stern  [25]  and  Hajek. 

The  latter  proof  Is  in  [5j. 

We  note  that  the  system  of  Example  l  of  Section  2  does  not  satisfy  these 


three  conditions.  Nevertheless,  it  is  p.-null  controllable  at  (x  ,0)  for  some 

o 

initial  states  x  , 
o 

The  Case  r>Ra.  When  OR™,  it  is  well  known  ^17,  p,  17l]  that  the  time- 

varying  system  (S)  is  completely  controllable  (globally  Rn-null  controllable  at 

t  in  our  notation)  if  and  only  if  the  rows  of  ;(t  ,  • ) B ( * )  are  linearly  indepen- 
o  o 

dent  on  some  bounded  interval  [t^T^.  Here  we  s^ow  that  when  Q*Rm,  equation  (2.1) 
is  a  necessary  and  sufficient  condition  for  global  Rm-null  controllability.  This 
is  accomplished  by  showing  that  (2.1)  is  equivalent  to  the  rows  of  $(t  ,*)B(*) 
being  linearly  Independent  on  some  bounded  interval  ^tQ,T2. 

Proposition  3.3.  (S)  jL£  global lv  Rm-nul 1  control lablc  if  and  only  if 


H  (B ' (t  )z(t  )  dT  •  + 
*  t  R® 


for  all  non-zero  solutions  z(*)  of  (S'). 


The  proof  of  this  result  is  in  Appendix  B. 


4.  Some  Computational  Aspects.  In  a  large  number  of  problems,  one  may 
have  to  resort  to  the  coogmter  to  check  whether  or  not  a  system  is  fl-null  con¬ 
trollable.  When  using  equation  (2.3),  a  solution  of  the  minimization  problem 
ainf J(xo,T,X) :  X  €  A^  is  needed.  Direct  application  of  so-called  gradient  or 
descent  algorithms  to  compute  min{j(xo,T,X) :  X  €  A^  is  precluded  by  the  fact 
that  J(x  ,T,X)  is  in  general  not  differentiable  in  X.  This  fact  is  a  consequence 
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of  che  sup  operation  involved  in  the  definition  of  H^(B ' (t  )®  '  (T,t  )X) .  Fortunately, 

W 

however,  numerical  computation  of  min{ J(xo,T,X ) :  X  6  A}  is  feasible  if  "generalized 
steepest  descent"  schemes  are  used.  These  schemes  rely  on  subdifferencial  rather 
than  gradient  information.  The  next  two  lensnas  develop  a  description  of  the  sub- 
differential  of  JCx^.T.X).  The  proofs  are  given  in  Appendix  C. 

Lenina  4.1.  For  fixed  (x^,T)  €  Rn  *  R,  J(xo,T,\)  _i£  a  lower  semlcontinuous 
convex  function  of  X . 

Lenina  4,2.  For  f  ixed  (x^.T)  €  Rn  *  R,  the  subdifferential  of  J(xo>T,’)  a£ 

V  €  Rn  cons  ists  of  all  vectors  X^  €  R°  o_f  che  form 

rT 

(4.1)  \  -  3(T,t  )x  *  |  a(T,T)B(T>Wr)dT 

w  O  O  J  w 

c 

o 

where 

(4.2)  x*(r)  €  arg  max  >  ’ B ' (t  )3  ’  <T,t  )X  :  x  €  f.3 

-  {*  6  n  :  x’B'  (t)c’  (T,t)X  S  *  3' (t)®’(T,t)X  V  T  € 
for  almost  all  r  €  ^0,T*. 

Remark.  Since  J(x  ,T,X)  is  the  support  function  on  the  attainable  set  (see 

-  o 

discussion  preceding  Theorem  2.3),  a  geometric  interpretation  of  the  subdifferential 
at  X  is  available:  This  set  consists  of  all  vectors  in  the  normal  cone  to  the 
attainable  set  at  X.  (See  Goodman  r24,  p.  285]). 

Formulae  (4.1)  and  (4.2)  hold  for  arbitrary  compact-convex  fi.  Often  however, 
more  structural  information  is  known  about  f).  In  such  cases,  (4.1)  and  (4.2)  may 
simplify.  To  illustrate,  suppose 
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Cl  -  r-M, ,M. ]  X  X  ...  x  r-M  ,M  ]  ;  (M.  >  0) 

l  l  *  *  mm  1 

Then,  the  maximum  in  (4.2)  is  achieved  in  the  iC^  component  by 

[%(t  )3t  €  sgnfB' (t  )2*  (T,t  )\]t  ;  i  -  1,2 . m 

where  sgn  x  ^  1  if  x  >  0;  sgn  x  *  -1  if  x  <  0;  sgn  0  ^  r-l,l'.  Consequently,  for 
this  case,  we  can  substitute  into  (4.1)  and  show  that  the  subdifferential 
xj(x  ,T,X)  consists  of  all  vectors  \  c  Rn  of  the  form 

O  " 

fkT  m 

(4.3)  X*  ■  2(T,0)Xo  +  I  Mihi(T,T)sgn  X’hi(T,T)dt 

*  o  1*1 

where  h^T.r)  is  the  iC^  column  of  H(T,r)  *  2(T,t)B(t).  This  description  of  the 

subdif fetentials  of  J(xo,T,*)  can  be  used  in  conjunction  with  the  generalized 

steepest  descent  algorithms  to  coraoute  min«rJ(x  ,T,X):  X  €  . 

o 

We  also  note  that  X#  is  uniquely  specified  by  (4.3)  if 

measure^  :  X'h^fT.t)  •  03  •  0  for  i  ■  l,2,...,m 

For  such  X,  3J(x  ,T,X)  Is  precisely  ?,J(x  ,T,X),  the  gradient  of  J(x  ,T,‘)  at  X. 
OXO  o 

5.  The  Steering  Control.  Using  the  results  of  Section  2,  we  can  determine 
if  (S)  is  r.-null  controllable.  However,  those  results  do  not  give  a  method  for 
determining  a  steering  control  u^(*)  €  ".(f.)  which  accomplishes  this  objective. 

One  method  of  determining  an  appropriate  u#(*)  is  to  solve  the  time  optimal 
control  problem,  i.e.,  find  u*(‘)  €  T,  (D)  which  steers  'S)  from  given  (xo,tQ)  to 
the  origin  and  does  so  in  minimum  time.  If  there  is  a  control  which  steers  the 
system  to  the  origin,  then  there  is  a  time  optimal  one  [2],  Hence,  in  principle, 
a  steering  control  can  be  numerically  computed  using  any  of  a  wide  variety  of 
algorithms  which  are  available  for  solution  of  the  time  optimal  control  problem. 

Since  the  solution  of  the  time  optimal  problem  is  determined  by  solving  a 
two  point  boundary  value  problem,  it  can  be  quite  difficult  to  obtain  the  steer¬ 
ing  control  this  way.  In  this  section,  a  ’’simpler"  alternative  method  for 


% 
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generating  a  steering  control  is  presented.  This  technique  does  not  involve  a 
two  point  boundary  value  problem  and  leads  to  a  control  which  steers  the  system 
arbitrarily  close  to  the  origin.  Our  result  is  obtained  from  the  following 

f 

minimum  norm  problem:  Given  initial  point  (x^t^)  and  a  final  time  T,  find 

u(«)  C'.fu)  which  leads  to  the  smallest  value  of  x(T)'  .  The  solution  of  this 
minimum  norm  problem  is  characterized  in  the  next  theorem. 

Theorem  5.1.  (See  Appendix  D  for  proof).  Let  (x  ,t  )  and  T  be  given. 

"  “■  ■  o  o  ■■  — 

Suppose  that  achieves  the  minimum  of  J(x^,T,A)  over  the  closed  unit  ball. 

Then  any  solution  of  the  minimum  norm  problem  satisfies 


(5.1)  u*(t)  €  arg  max(uj '  B*  (t  )c  ’  (T,t  )\+  :  a*  €  fil 

for  a Imos t  al 1  t  6  rtQ,T2. 

We  note  that  condition  (5.1)  will  uniquely  determine  u^(-)  whenever  the 
minimum  of  4  ' B ’ (t )t ' (T,t )X^  is  uniquely  achieved.  For  example,  suppose 

n  -  r-M.  ,M.]  X  r-M?1JL,:  X  ...  x  [-M  .M 3  (M.  >  0)  . 

11  mm  l 

Then  (5.1)  requires 


(5.2)  C«*(T  >3t  €  MtSgntVOOC’er.TjX*^  ,  1-1,2 . a. 

For  the  case  when  the  minimum  of  x(T)  -  0,  -  0  and  (5.1)  will  not 

determine  a  control  which  steers  (S)  to  the  origin.  The  following  heuristic 
procedure  can  be  used  to  determine  a  control  which  steers  (S)  arbitrarily  close 
Co  the  origin:  Choose  a  T  such  that  the  minimum  of  x(T)  is  nonzero.  As  T  is 
increased,  the  minimum  of  x(T)  approaches  zero  and  the  corresponding  solution 
u*(‘)>  generated  via  (5.2),  of  the  minimum  norm  problem  results  in  a  control 
which  steers  the  system  progressively  closer  to  the  origin. 


(S)  here  is  required  to  be  R^-null  controllable. 
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la  our  next  theorem,  we  provide  another  useful  characterization  of  steering 

controls.  For  fixed  T  €  r0,»),  x  €  Rn,  we  define  the  functional  V  :  Rn  *  T.(T.)  -*  R 

O  T 

by 

rT 

V_(X,uO)  -  X'«(T.0)X  +  X  3  (T,T)B(T)u(T)dr 

T  0  ‘0 

Theorem  5.2.  (See  Appendix  D  for  proof).  Pick  any  compact  convex  set  A  con¬ 
taining  zero  as  an  interior  point .  Then  V^(X,u(*))  possesses  at  leas  t  one  saddle 
point  (X*. «*("))  €  A  *  T.O).  Moreover  ,u^( • )  steers  xq  to  zero  at  time  T  .if  and 
only  if  VT0,t,u^(-))  ■  0. 

i 
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6.  Additional  Applications.  In  this  section,  we  use  our  results  to  obtain 
an  existence  theorem  for  the  time  optimal  control  problem  and  also  apply  our 
results  to  a  pursuit  game. 

Existence  of  Time  Optimal  Controls.  Consider  the  following  time  optimal 

control  problem:  Find  u(-)  €7l(r.)  which  drives  the  state  x(*>  of  (S)  from  an 

Initial  position  x(t  )  -  x  to  the  origin  and  minimizes 

o  o 

.*f 

C(u(*))  ■  dt  C.  ■  arrival  time  at  the  origin. 

‘  t  £ 

o 

The  classical  theorem  for  existence  of  a  time  optimal  control  (e.g.,  Lee  and 
Markus  [2*)  requires  chat  there  is  at  least  one  control  which  transfers  the 
state  x(*)  of  (S)  to  the  origin.  Combining  the  result  of  [2^  with  our  Theorem  2.3, 
we  obtain  the  following  existence  lensna. 

Lena  a  6,1.  There  exists  £  solution  to  the  time  optimal  control  problem  If 
and  on  1 v  1 f  there  Is  some  finite  t,  €  rto>»)  such  that 

min(j(x  ,tf,X):X€Al*0 


Furthermore .  the  time  optimal  cos t  Is  given  by 

C*(u#(-))  ■  aln(tj  :  min[ J(xQ,tj,X)  :  X  €  /.]  ■  CO 

Pursuit  Canes.  Next,  we  consider  the  pursuit  game  studied  by  Hajek  [18.. 
The  system  Is  described  by 

(6.1)  *(t)  -  Ax ( t)  -  p(t)  ♦  q(t)  ;  p(t)  €  P  ,  q(t)  €  Q  x(tQ)  -  xq 

where  P  and  Q  are  compact  convex  subsets  of  R°.  The  pursuer  p(*)  seeks  a 
strategy  j  :  Q  *  [to>»)  -»  P  which  steers  x(-)  to  the  origin  for  all  possible 
quarry  controls  q(-)  :  [to>»)  *•  Q.  A  quarry  control  is  admissible  if  It  is 
measurable  and  a  strategy  is  admissible  If  e(-)  preserves  measurability. 
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In  [l8',  4  solution  to  this  problem  is  obtained  in  terms  of  the  associated 
control  system 

(6.2)  y (t)  -  Ay (t)  -  u(t)  ;  u(t)  €  P  -  Q  ;  y(tQ)  -  xq 

★ 

where  P  -  Q  is  the  Pontryagin  difference.  i.e., 

P  ^  Q  4  (x  £  r"  :  x  +  Q  C  pi  . 

Admissible  controls  u(’)  above  must  be  measurable. 

Simply  put,  Hajek's  result  says  that  the  state  x(-)  of  (6.1)  can  be  forced 
to  the  origin,  for  all  admissible  q(*),  if  and  only  if  the  state  y(-)  of  (6.2) 
can  be  steered  to  che  origin.  More  precisely,  the  following  theorem  is  available. 

First  Reciprocity  Theorem  [ lS^ .  Initial  pos it  ion  x^  _in  (6.1)  can  be 
'.s troboscopical ly)  forced  to  the  origin  at  time  T  ?  tQ  bv  a  strategy  c ( • )  if 
and  only  t f .  x^  _in  (6.2)  can  b£  steered  to  the  origin  at  t ime  T  bv  an  admissible 
control  u(-).  Furthermore ,  ?(•)  and  u(*)  are  related  bv 

(6.3)  ?(q,t)  -  u(t)  +  q  . 


By  applying  Theorem  2.3  to  (6.2),  we  obtain  another  condition  for  deter¬ 
mining  if  (6.1)  can  be  forced  to  the  origin. 

♦  n 

Lcrmr.a  6.2.  As s •  ane  P  -  Q  compact .  Pick  any  subset  A  o£  R  containing  zero 
as  an  interior  point .  Then  in  (6.1)  can  be  forced  to  the  origin  at  time 
T  ^  tQ  bv  a  strategy  C (')  and  only  if 

min{K(xo,T,\)  :  X  €  Al  •  0 


K(x  ,T,X)  ^  x'e 


a’<t  *  c«>  rT  att  ^ 

X  ♦  T  >X)<h 

*  t  P'Q 
0 


where 


It  should  be  pointed  out  that  In  addition  to  pursuit  game  Interpretation 
of  (6.1),  (6.1)  can  also  be  viewed  as  a  problem  of  steering  a  system  with  dis¬ 
turbances  to  the  origin  If  q(-)  Is  thought  of  as  a  disturbance.  Also,  the  results 
apply  to  systems  described  by 

*(t)  -  Ax(t)  +  Bp(t)  +  Cq  ( t )  ;  p(t)  €  P  ,  q(t)  6  Q 
If  one  replaces  Bp(t)  by  p'(t),  Cq(t)  by  -q'(t),  P  by  BP  and  Q  by  CQ. 
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APPEND  LX  A 

Proof  of  Theorems  2.1,  2.3  and  Corollary  2.2.  Since  Theorem  2.3  Is  used  In  che 
proof  of  Theorem  2.1,  we  first  present  the  proof  of  Theorem  2.3.  There  are  many 
ways  to  prove  Theorem  2.3;  our  proof  exploits  the  convexity  of  che  attainable  set 
In  conjunction  with  a  measurable  selection  theorem.  We  note  that  a  proof  of  the 
sufficiency  part  of  Che  theorem  la  given  In  [6,  Theorem  7.2. l}.  To  simplify  our 
notation, we  henceforth  take  t^“  0  without  loss  of  generality.  This  will  apply 
to  subsequent  appendices  as  well. 

Proof  of  Theorem  2,3.  Let  A^(x^)  be  the  set  of  states  which  can  be  attained 

from  x  at  time  T,  1 . e . , 
o 

f  rT  ' 

(A.  1 )  A,(x  )  -  J3(T,0)x  +  s(T,t)B(t)u(t)<*t  :u(-)€Rl<n)h  . 

1  v  O  J  J 

o 

The  set  A_(x  )  is  convex  and  compact  r2].  From  Def.  1.1,  it  follows  that  x  can 
To  o 

be  steered  to  0  at  time  T  if  and  only  if  OgA^Cx^  or,  equivalently,  by  the  Separating 
Hyerplane  Theorem  [2l], 

(A. 2)  0  <  sup/x'a  :  •€AT(x£))‘ 

for  all  vectors  V  €  Rn.  Using  (A.l),  requirement  (A. 2)  becomes 

rT  .  \ 

(A. 3)  X'#(T,0)x  ♦  s  up*  '  X  #  (T,t  )B(t  )u(T  )dr  :  u(-)  (T.)  v  i  0 

0  *o 

for  all  X  €  Rn.  As  a  consequence  of  the  measurable  selection  theory  of  fl93,  we 
can  coosnute  the  supremum  and  Integral  operations  In  (A. 3)  .  Thus,  0  €  A^(xq)  if 
and  only  If 

rT 

(A. 4)  OiX'ilT.O)*  ♦  :  IL(B,(t)«,(T,t)X)<K  •  J(x  .T.X) 

o*  T»  o 

o 

for  all  X  €  Rn.  Since  J(xq, T,X)  is  poaitivaly  homogeneous  In  X,  we  can 
restrict  X  to  A  In  (A. 4).  Theorem  2.3  now  follows,  □ 

*  3(T,t)  B(t)  being  a  Cartheodory  function  enables  us  to  apply  the  results  of  [19], 

1 


■■DM 
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Taking  A  •  R  in  Theorem  2.3,  it  follows  that 


min{j(xo,t,X)  :  X  €  Al  *  J(xQ,t,Xc)  <  0 


for  all  t  6  [0,»).  By  Theorem  2.3,  (S)  is  not  0- null  controllable  at  (xq,0).  d 


(Sufficiency):  Now,  we  assume  that  (A. 5)  holds.  Again,  we  proceed  by  con¬ 
tradiction,  i.e.,  suppose  (S)  is  not  globally  Cl-null  controllable  at  t  ■  0. 

Hence,  there  exists  an  initial  condition  x  i  0  which  cannot  be  steered  to  zero. 

o 

n  oc 

3y  Theorem  2.3  (with  A  •  R  ) ,  we  can  find  a  sequence  of  times  an<*  a 

sequence  of  vectors  (^j^k-l  having  the  following  properties: 

Pi.  llm  t.  ■  +  •  ; 

k  «•  •  * 

P2 .  <  0  for  k  -  1,2,3... 

We  are  going  to  construct  an  initial  condition  *  0  for  (S')  which  makes  the 
Integral  in  (A. 5)  finite.  To  meet  this  end,  let 

*,(yQ)xk 

tk,>'"'k 

We  note  Chat  each  above  is  non-zero  because  X^  ^  0  and  £(^,0)  is  invertible. 
Then  (z^^^  is  a  sequence  in  Rn  belonging  to  the  set 

S  »  [z  €  Rn  :  jizi!  -  11  . 


»  k  ■  1 12 1  •  • «  • 

!!®’(t.  ,o)x'' 


Since  S  is  compact,  we  can  extract  a  subsequence  ( z^  which  converges  to 

some  vector  1  €  S.  We  will  now  show  that  1  is  the  initial  condition  which 

o  o 

we  seek.  Let  z(*)  be  the  trajectory  of  (S’)  generated  by  z(0)  &  "zo;  let  (t^ 
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denote  the  subsequence  of  times  corresponding  to  ( z,  .  By  PI,  we  have 

K  j  J"  *• 

lijn  C.  ■  4*  ® 

j  -* »  j 

and  by  p2,  it  follows  that 

Xo'3’(tk  ,0)Xk  *1  Hn(B*(T)fl’(tk  ,T)\k  )dr  <  0  J^r  j-  1,2,3,... 


J  Jo 


J  J 


Dividing  by  3'(t,  ,0)\  and  noting  that  is  positively  homogeneous,  we 

obtain 

a.fB'^Jo'fO.T):.  )dr  s  x)  'Iz  II  for  j-  1,2,3,... 

*o  *J  °  kJ 

1  \  J  “  1.2.3,... 

We  would  like  to  obtain  an  inequality  involving  z  with  an  infinite  upper  limit 

o 

on  this  Integral.  To  accomplish  this,  we  define 

f.  (T)  $  H^CB'(T)a'(0,T>z  )  if  T  €  ro.c.  1  ; 

J  J  J 

^  0  Otherwise;  J  -  1,2,3,...; 
f(r)  4  H^(B'(t)#’(0,t)I  )  ;  r  €  [0,») 

I  4  O 

and  make  the  following  observations ; 

(i)  f.  (t )dT  is  bounded  (by  x*' )  for  J  »  1,2,3,... 

*  o  kJ  ° 


(ii)  f.  (t  )  converges  polntvlse  to  f  (t  )  on  [0,«»).  This  observation  is 

J 

proven  using  the  facts  that  l.  •*  1  ,  t,  -•  +  ■  and  H_  depends  con- 

kj  o  Tt 

tlnuously  on  its  argument. 
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Applying  Fatou's  lemma  [20,  p.  83}, we  have 


f(T)dT  <  lim  inf  f.  (t)«Jt 
o  J  -*  «  ‘o 


*• 

i  lim  sup  ^  ffc  (r)dT 
J  -♦  ®  "  o  J 


i  it  x*: 

a' 


Substitution  for  f(r)  above  gives 


*  IL^B'Ct  )«'(<), t)z  )dT  i  ’U5l  , 
I  ..  o  o 


lU(B’(T)2(T))dT  <  X*j 
•  4  O 


<  » 

which  is  the  contradiction  that  we  seek.  This  conpletes  the  proof  of  the  theorem. 

Proof  of  Corollary  2.2.  Suppose  fi  and  O'  satisfy  the  hypotheses  of  the 
corollary.  We  are  going  to  show  that  (S)  is  globally  O'-null  controllable.  To 
prove  this,  it  is  sufficient  to  find  a  subset  0g  C  O'  such  that  (S)  is  globally 
rig-null  controllable:  Pick  4  >  0  such  that 

ft  {*;  i|*|j  <  ai  c  n' 

(This  can  be  accomplished  because  zero  is  interior  to  O'.)  Now,  to  prove  that 
0g  has  the  desired  property,  we  pick  R  >  0  such  that 

nR  ft  {«:  Ml  <  R}  2  ft 


(This  can  also  be  done  since  0  is  compact,  hence  bounded.)  Let  z(*)  be  any 


non-zero  solution  of  (S').  Then  we  have 


H„  i  (B ' (t  )z(t  )  )dr  ■  sup(u) ' B ' (t  )z (t  )  :  tui  i  Mdx 
‘  o  “6  'o 

rm 

-4  B ' (t  )  z  (t  )l!  dx 


ft 

-  -  ^  R  B'(t):(t)I  dt 


■  ^  sup(a) '  B 1  (r  )*(r ) :  \\4  <  R\dr 


-4  (B’(T)z(T))dr 

R  ‘  o  “R 


since  (S)  is  globally  r.D-null  controllable.  (f.  -null  controllability  follows  from 

w-null  controllability  in  conjunction  with  the  fact  that  By  Theorem  2.1, 

we  conclude  that  (S)  must  be  globally  "'-null  controllable  and  hence  H'-null  con- 

c 

trol lable.  □ 
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APPENDIX  B 


Proof  of  Theorem  3.2.  (1):  This  condition  follows  immediately  from  the  fact 
that  global  Ra-null  controllability  is  necessary  for  global  f.-null  controllability. 

It  is  also  possible  to  prove  (i)  directly  from  Theorem  2.1.  Suppose  (S)  is 

globally  r.-null  controllable  but  rank  (Q)  <  n.  Then  there  exists  a  v  €  Rn,  v  i  0, 

such  chat  3'e  A  Cv  ■  0  for  all  c  2  0.  Let  z(0)  -  v.  Then  z(r)  ■  e"A  Cv  and 

J  sup  (u» 'B '  z  (t  )  )dr  ■  sup  (w'B'e  v)dr  ■  0 
*  o  \u€  0  "  o  fl 


which  contradicts  Theorem  2.1. 

(il):  Suppose  (S)  is  globally  f.-null  controllable  but  there  exists  a  real  eigen¬ 
vector  v  of  A'  satisfying  ji'B'v  i  0  for  all  -4  €  f..  Denoting  by  X  the  real  eigen¬ 
value  associated  with  v,  we  have  e  A  Cv  ■  e  Cv.  With  z(0)  »  v,z(t)  -  e  A  Tv  •  e  *Tv 


sup  (ai'B'z(T)dT  ■  sup 

*  o  jj€  0  *  o  w€  Cl 


sup  (m'B'e  Tv)dt 


■  e  sup  (a)'B'v)dT 

*  o  a>€  Cl 

Now  this  Integral  is  less  chan  or  equal  to  zero  since  sup  (oi'B'v)  s  0  and  e  *'C  2  0. 

a>€  Cl 

This  contradicts  Theorem  2.1. 

(ill):  Again  the  proof  is  by  contradiction.  Assume  (S)  is  globally  Q-null  con¬ 
trollable  but  A  has  an  eigenvalue  X  with  a  positive  real  part.  Then  X  is  also  an 
eigenvalue  of  A'  so  chat  A’v  •  Xv  where  v  is  an  eigenvector  corresponding  to  A*. 

Let  X  and  v  denote  the  complex  conjugate  of  X  and  v.  They  satisfy  Av  »  Xv.  Hence, 

-A’t  Xt  .  -A’t-  Xt- 

e  v  •  e  v  and  e  v  •  e  v 


Consider  the  solution  of  the  adjoint  equation  corresponding  to  the  initial  con¬ 
dition  z(0)  •  v  ♦  v.  (Note  that  z(0)  is  real.)  For  this  z(0) 
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sup  (ui'B'z(t))  ■  sup  (tu'B'e  A  T  (v  +  v)) 
ui  €  fl  ui  €  n 

r  .D.f  -xt 

m  sup  ui  B  I  e  v  +  e  v. 
ui  €  a L 

■  sup  -ui'B'e  atr2m  cos  bt  +  2n  sin  be]  - 

•ui  €  a  '  J 

where  a  and  b  are  the  real  part  and  imaginary  part  of  X  and  n  and  m  are  the  real 
part  and  imaginary  part  of  v.  Let  M  -  sup  sup  ui'B'f2n  cos  bt  +  2n  sin  bt]. 

t  2  o  ui  €  n 

M  is  finite  since  H  is  compact,  i.e.,  M  £  2  maxf  1  n|  , | m|  1  B:  sup  uii  .  Thus 

ui  €  n 

sup  (uTB'r(T))  £  Me"at 

u>  €  0 


sup  (ui 'B 'z(t  )  )dr  £  M  e  dt 
v  o  ui  €  Cl  *  o 

The  integral  on  the  right  is  finite  since  a  >  0  and  we  have  a  contradiction  to 
Theorem  2.1. 


Proof  of  Proposition  3.3.  (Necessity):  Suppose  (S)  is  globally  R  -null 

controllable.  Then  there  is  a  finite  interval  [0,T]  on  which  the  rows  of 

i(0,*)B(*)  are  linearly  independent.  Thus,  for  every  non-zero  vector  Zq  €  Rn, 

It  follows  that  B ' (t)C ' (0, t)z  i  0  for  some  t  €  fO,T].  Since,  B ' ( • )$ ' (0, • )z 

o  o 

is  continuous,  there  must  be  an  Interval  I"[t-6,t+6]on  which 

B ’ (t )fi ' (0,t )z  *  0  for  all  t  €  I.  On  this  interval,  we  have 
o 

sup(ui  B ’ (t  )®  '  (0,r  )Zo  :  ui  €  R^  •  +  « 

Hence,  using  the  non-negativity  of  ( • ) ,  we  conclude  that 

*  r 

H  ,(B'(T)z(T))dT  2  H  )dx 

*  o  R  *IR 

»  sup{ui  '8 1  (t  )£  '  (0,t  )z  :  ui  €  Rm^dT 
"  I  ° 
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(Sufficiency):  Proceeding  by  contradiction,  we  suppose  that  for  all  non-zero 
solutions  z(»)  of  (S'),  we  have 


H  (B '  (r  )z(t  )  )dT  ■  ® 


r,® 

o  R 

but  the  columns  of  B ' ( • )d ' (0 , * )  are  linearly  dependent  on  every  bounded  interval 
—  ® 

0,T,.  Let  (T  >  ,  be  a  monotone  increasing  sequence  of  times  such  that  T  •*<*>. 

-  n  n*l  o-i  n 

Then,  for  each  n,  we  can  find  a  non- zero  vector  ~z  such  that  B ' (t )® '  (0  )!:  a  0 

n  n 

on  r 0 , T  ] .  Let 
n 


t  1  — -2- 

"  ™Ji 


for  n  -  1,2,, 


Then,  (z  .  U  a  sequence  in  the  (compact)  unit  ball.  Hence,  we  can  extract  a 
n  n- 1 

subsequence  z  converging  to  some  z  ,  z  »  1.  We  notice  that  the  corresponding 
n^  o  o 

subsequence  of  times  T  still  converges  to  +  *.  Furthermore,  for  each  fixed 


r  6  ^0,»),  we  have 


J 


B'(t)C’(0,t)2  -  llm  B’(t)«'(0,tU 

o  ,  n 

)  -*  *  J 


Consequently,  if  z(t)  is  the  trajectory  mate  of  zq, 

m 

H  (B'  (t  )z(t  ))dr»  sup[x  ’ B ' (t  )£ '  (0,t  )z  :  x  €  R  )dT  ■  0 

%  nB  •  O 

o  R  o 


wh'ch  contradicts  the  assumed  hypothesis 


APPEND  IX  C 


Proof  of  Lenina  4.1.  For  (x^.T)  fixed,  Jfx^.T.X)  can  be  expressed  as 
J (X0»T,\)  -  sup[H^(X)  :  *(•)  €*.<£))} 

where 

a  -T 

H  (X)  ■  \'3(T.0)x  ♦  X'3(T,T)B(TVu(T)dT  . 

it  O  » 

o 

Consequently,  J(x^,T,’)  is  the  pointwise  supremum  over  an  indexed  collection  of 

continuous  linear  (hence  convex)  functions.  Hence  J(x  ,T,«)  itself  must  be  con- 

o 

vex  and  at  least  lower  semi continuous  (in  fact,  continuous). 


Proof  of  Lenina  -*,2.  We  prove  this  lemma  using  some  of  the  standard  prop¬ 
erties  of  subdifferentials  given  in  Rockafellar  [2l],  r22*.  Since  both  functions 

in  the  definition  of  J(x  ,T,X)  are  finite  and  convex, \  €  >J(x  ,T,X)  if  and  only 

o  *  o 

if 


Now,  by  Corollary  23.5.3  of  [2lj,  »  (t)  €  3H-(£(t))  if  and  only  if 

x#(t)  €  arg  maxfii ’I  (t  )  :  «  €  0^ .  Substituting  the  required  form  for  £  above,  we 

obtain  our  desired  representation  for  \  . 
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APPENDIX  D 

Sketch  of  a  Proof  of  Theorem  5.1.  Let  f  :  lVo.TiR®)  -»  R,  g  :  Rn  -♦  R, 

.\T  :  (0 , T ; Rffl)  -•  Rn  be  given  by 

f(u)  &  0  If  u(*)  €  T.  (Q)  ;  f(u)  ■  ®  otherwise  ; 

*U>  &  -  "«(T,0)xo  +  s'  ;  z  €  Rn  ; 

\  -T 

Atu  »  3(T,T>B(T)u(T)dT  . 

*  o 

Then,  using  the  notation  above 

inf(MN)  ■  lnf("x(T)i'  :  u(-)  €-.(Cl)} 

-  inf  [  f  (u)  -g(.\Tu)  :  u  €  Ll(0,T;R°)'*  . 

Written  in  this  way,  inf(MN)  is  in  the  standard  form  for  application  of 
Rockaf e 1 lar ' s  extension  of  Fenchel's  Duality  Theorem  (cf.  [23],  Theorem  i).  The 
functionals  f  and  g  are  respectively  proper  convex  and  concave  functions;  it  can 
be  easily  shown  that  lnf(MN)  is  "stably  set"  --  a  technical  precondition  for 
Sockafe 1 lar 's  Theorem. 

By  carrying  out  the  cocrpu  tat  ions  Involved  in  Theorem  1  of  r23],  it  can  be 
shown  that  the  problem 

oinOlN)*  &  min{ J(x  ,T,\)  :  X  €  *.} 
o 

is  dual  to  inf(MN)  in  the  following  sense: 

inf(MN)  +  oin(MN)*  -  0  . 

The  "extremalitv  condition"  in  Rockafellar 's  theorem  provides  a  necessary  con- 

* 

ditlon  which  must  be  satisfied  by  all  solution  pairs  solving  (MN)  and  u^(’) 
solving  (MN).  This  extremalitv  condition  requires 


where  A*  Is  the  adjoint  of  f  and  Jf(u^)  Is  the  subdifferential  of  f  at  u#.  For 
our  choice  of  f,  this  necessary  condition  particularizes  to 

\*3(T,t)B(t)  €  (Normal  cone  of  faff))  at  u#(-)) 

We  denote  this  normal  cone  at  u#  by  N^fu^).  By  definition  of  the  normal  cone,  we 

have  v(-)  €  N  (u  )  if  and  onlv  if 
c 

.T  rT 

ui(t  )B ' (t  )C  '  (T,t  )V#dr  -  sup{«  ' B ' (t  )C  1  (T,t  )\  :  m  €  flldT  . 

o  o 

This  is  possible  only  if  u>  •  u^(r)  achieves  the  supremum  of  m  '  B ' (t  )C '  (T  ,t  )X# 
for  almost  all  r  €  r0,T2.  Equivalently,  we  must  have 


u^(t)  €  arg  max{ui’B '  (r  )C '  (T,r  )X#  :  x  €  ?.) 


for  almost  all  r  €  r0,T[. 


proof  of  Theorem  5.2.  as  in  the  proof  of  Theorem  2.3,  let  A^,(xq)  be  the  set 

of  states  which  can  be  attained  from  x  at  time  T.  We  recall  that  this  set  is 

o 

compact  and  convex.  Define  W_  :  A  *  A*.  (x  )  R  bv 

T  To 


(D.l) 


wT(\t?>  -  X’? 


tn  accordance  with  Proposition  2.3  of  [19,  p.  17l',  will  possess  a  saddle 

point  because  the  following  conditions  are  satisfied: 

(D.2.1)  For  all  \  €  A,W(X,#)  is  concave  and  upper  semicontinuous . 

(D.2.2)  For  all  ?  €  H-ffl) ,  W(*,5)  is  convex  and  lower  semicontinuous. 

Since  W^fX,?)  possesses  a  saddle  point,  we  note  that 


min  max  V  (X,u(*))  ■  *1°  sn*x  W„(X,$) 

\€A  u(*)€T.(r.)  T 


*€A  ?€At(xq)  T 


max  min  V  (X,u(*>) 

u(*)€^(fl)  XCA  T 


max 


?€At(xo)  XCA 


min  WT(\,C)  . 


Furthermore , 


These  equalities,  in  conjunction  with  the  fact  that  possesses  a  saddle  point, 
imply  that  also  has  a  saddle  point. 

To  prove  the  last  part  of  the  theorem,  we  take  (X*,u^('))  to  be  a  given 
saddle  point  of  V^(\,u(-)).  Hence  we  have 


(D .  3  > 


V  (X  ,u  (•))  -  sax  V 

X€A  u(*)€T.(n) 


V_(X  ,u(  • ) )  . 


Using  a  measurable  selection  argument,  as  in  the  proof  of  Theorem  2.3,  it  is 
also  apparent  that 


(D.i) 


min  max  V  (X,u(*))  ■  rain  J(x  ,T,X) 
X€A  u(-)€T.(n)  X€A 


From  0.3)  and  (0.4)  we  conclude  that 


(D.5) 


;t(L,u»(-))  -  sin  J(x  T.X) 
T  \  0 


From  Theorem  2.3  and  the  coements  following  the  theorem,  we  know  that  xq  can 
be  steered  to  zero  at  time  T  if  and  only  if 


0  -  min  J(x  ,T,X) 


-  VT(X*,u*(-))  (by  (D.5)). 


To  complete  the  proof,  wc  must  show  that  if  V^(X#,u^(*))  •  0,  then  u  (•) 


steers  x  to  0.  Now 
o 


VT(X*. “*(•)>  4  VT(X,u*(-))  tor  all  X  €  A 


r  (**  "I 

0  <  X"  3(T,0)x  +  3(T,t)B(t)u.  (t)<*t  for  all  X  €  A. 

o  .  -» 

o 
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Thus 

(D.6)  0  <  X'  x(T,x  ,u  (•))  for  all  X  €  A 

o 

Since  0  Is  an  Interior  point  of  the  convex,  compact  set  A,  (D.6) 

x(T,x  .u.C’))  •  0  and  u.(-)  Is  a  steering  control. 

o  *  * 
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NULL  CONTROLLABILITY  OF  LINEAR  SYSTEMS  WITH  CONSTRAINED  CONTROLS 
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Abstract.  The  paper  considers  the  problem  of  steering  the  state  of  a  linear 
time-varying  system  to  the  origin  when  the  control  is  subject  to  magnitude 
constraints.  Necessary  and  sufficient  conditions  are  given  for  global  con¬ 
strained  controllability  as  well  as  a  necessary  and  sufficient  condition  for 
the  existence  of  a  control  (satisfying  the  constraints)  which  steers  the  system 

to  the  origin  from  a  specified  initial  epoch  (x  ,t  ).  The  global  result  does 

o  o 

not  require  zero  to  be  an  interior  point  of  the  control  set  Q  and  the  theorem 
for  constrained  controllability  at  (x^t^)  only  requires  that  T.  be  compact, 
not  that  it  contain  zero.  The  results  are  compared  to  those  available  in  the 
literature.  Furthermore,  numerical  aspects  of  the  problem  are  discussed  as 
is  a  technique  for  determining  a  steering  control. 
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Introduction  and  Formulae  Ion.  Consider  the  problem  of  steering  the 


U 

state  of  a  linear  system 

(S)  *(t)  •  A(t)x( t)  •*.  B(t)u(t) ;  t  €  lC0,») 

to  the  origin  from  a  specified  initial  condition 

*(t  )  "  x„ 
o  o 

by  choice  of  control  function  u(*).  Here  x(t)  €  Rn,  u(t)  €  Ra  and  A(*)  and  B(*) 

f 

are  continuous  matrices  of  appropriate  dimension.  Unlike  the  usual  controll¬ 
ability  problem  where  the  control  values  at  each  instant  of  time  are  uncon¬ 
strained,  we  insist  here  that  the  control  values  at  each  instant  of  time  belong 
to  a  prespecified  set  n  in  Ra. 

Letter.)  denote  the  set  of  functions  from  R  into  f.  that  are  measurable  on 

rt  ,•).  Then  anv  control  u(»)  €T.(f.)  is  termed  admissible.  We  now  define 
o 

three  notions  of  constrained  controllability  or,  more  precisely,  .“-null  controll¬ 
ability. 

Definition  l.l.  The  linear  system  (S)  is  f.-null  controllable  at  (xo>tQ) 

if,  given  the  Initial  condition  x(t  )  ■  x  ,  there  exists  a  control  u(’)  €  *Ti (fT ) 

o  o 

such  chat  Che  solution  x(*)  of  (S)  satisfies  x(t)  ■  0  for  some  t  €  ft  »“)• 

■  o 

Definition  1.2.  The  linear  system  (S)  is  globally  f.-null  controllable 

it  c  if  (S)  is  f.-null  controllable  at  (x  ,t  )  for  all  x  €  Rn. 

—  o  ooo 

Our  major  result  will  pertain  to  the  global  type  of  controllability.  To 
cotig>are  our  results  to  chose  of  previous  researchers,  we  also  need  a  local  con¬ 
trollability  concept. 

Definition  1.3.  The  linear  system  (S)  is  locally  f.-null  controllable  at 

tQ  if  there  exists  an  open  set  V  C  Rn,  containing  the  origin,  such  that  (S) 

is  null  controllable  at  (x  ,t  )  for  all  x  €  V. 

o  o  o 

This  requirement  can  be  weakened  to  local  lntegrablllty. 


The  majority  of  constrained  controllability  results  are  for  autonomous 


-  2 

systems,  i.e.,  systems  where  A  and  B  are  constant.  When  fl  •  r”,  Kalman  [l[ 
showed  that  a  necessary  and  sufficient  condition  for  global  R^-null  controll¬ 
ability  is  rank(Q)  •  n  where  Q  *  [B,AB . A°  *B[.  Lee  and  Markus  [2]  con¬ 

sidered  constraint  sets  Cl  —  R*  which  contain  u  »  0  and  showed  that  rank(Q)  •  n 
is  a  necessary  and  sufficient  condition  for  (S)  to  be  locally  fl-null  controllabl 
Furthermore,  if  each  eigenvalue  X  of  A  satisfies  Re(\)  <  0,  then  (S)  is  globally 
fl-null  controllable.  This  result  is  typical  of  the  results  available  when  0 
contains  the  origin. 

Saperstone  and  Yorke  [3[  were  the  first  to  eliminate  the  assumption  that 
zero  is  an  interior  point  of  fl  when  they  considered  problems  with  m  •  1  and 
fl  ■  ^ 0 , 1 2 •  Their  result  states  that  for  these  problems  (S)  is  locally  T.-null 
controllable  if  and  only  if  rank(Q)  ■  n  and  A  has  no  real  eigenvalues.  They 
also  extend  this  result  to  m  >  1  and  consider  the  m-fold  product  set  fl  -  7^[Q,l[ 
Problems  with  more  general  constraint  sets  were  studied  by  Brammer  '<*'  who 
shewed  that  if  there  exists  a  u  €  fl  satisfying  3u  ■  0  and  the  convex  hull  of  fl 
has  a  nonempty  interior,  then  necessary  and  sufficient  conditions  for  local 
7-null  controllability  are  rank(Q)  •  n  and  the  nonexistence  of  a  reai  eigen¬ 
vector  v  of  A'  satisfying  v'Bu  <  0  for  all  u  €  fl.  In  addition,  if  no  eigen¬ 
value  of  A  has  a  positive  real  part  then  the  theorem  becomes  one  for  global 
7-null  controllability.  A  similar  result  for  global  controllability  when 
fl  •  [0,1*  was  obtained  by  Saperstone  f 5] .  Friedman  [6]  considers  a  linear 
pursuit  evasion  problem  where  the  target  is  a  closed  convex  set  and  gives  a 
sufficient  condition  for  the  existence  of  a  pursuer  control,  based  on  the 
evader's  control,  which  drives  the  system  from  a  specified  initial  condition 
to  the  target. 

For  nonautonomous  systems,  the  most  familiar  controllability  result  is  that 

of  Kalman  [l]  when  fl  •  R®.  He  showed  that  (S)  is  Ra-null  controllable  if  and 

only  if  W(t  ,t.)  Is  positive  definite  for  some  t,  €  [t  .•)  where 
0  1  i  o 


3 


a  r  4 

W(Co>tl)  #(C1,T)B(T)B'(T)«,(t1,T)dr 

Co 

and  ;(c,r)  is  the  state  transition  matrix  for  (S).  When  the  control  is  con¬ 
strained,  the  major  global  results  are  those  by  Conti  [7]  end  Pandolfi  rgT.  In 
'73,  Conti  describes  a  "divergent  integral  condition”  which  is  necessary  and 
sufficient  for  global  H-null  controllability  when  r.  is  the  closed  unit  ball.  In 
order  to  make  Conti’s  result  more  compatible  with  existing  theory  for  time- 
invariant  systems,  Pandolfi  in  [8]  defines  the  notion  of  p-th  characteristic 
exponent  for  time  varying  systems.  For  the  special  case  when  the  system  is  time- 
invariant,  the  characteristic  exponent  turns  out  to  be  the  real  part  of  some 
eigenvalue  of  A.  Subsequently,  controllability  criteria  are  provided  in  terms 
of  this  exponent. 

The  r.-null  controllability  problem  is  also  studied  in  papers  by  Dauer  39-» 
3l03,  Chukvu  and  Gronski  [ll3  *nd  Chukvu  and  Silllman  3^3.  In  order  to  decide 
on  the  question  of  fl-controllability ,one  must  test  a  certain  growth  condition 
which  involves  searching  a  function  space.  In  concrast,  the  results  given  here 
are  finite-dimensional  in  nature. 

In  '133,,  Grantham  and  Vincent  consider  the  problem  of  steering  a  nonlinear 
system  to  a  target.  They  present  a  technique  for  determining  the  boundary  between 
the  set  of  states  which  can  be  steered  to  the  target  and  those  which  cannot. 

More  recently,  Murthy  and  Evans  [1&3  obtained  results  comparable  to  [33-35.  for 
discrete  linear  systems  and  Pachter  and  Jacobson  [153  developed  sufficient  con¬ 
ditions  for  controllability  for  case  where  A(*)  and  B(*)  are  time- invariant  and 
n  is  a  closed  convex  cone  containing  the  origin.  A  readable  account  of  the 
state  of  the  art  is  contained  in  the  book  by  Jacobson  3  ,  Chapter  53. 

In  contrast  to  much  of  Che  work  of  previous  authors,  this  paper  concentrates 
on  the  case  where  A(-)  and  B(*)  are  time-varying.  Our  results  for  global  T.-null 
controllability  are  for  constraint  secs  .'  chat  are  compact  and  contain  zero 
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(but  not  necessarily  as  an  interior  point).  One  of  our  main  results  on  global 
T.-null  controllability  is  an  extension  of  a  theorem  of  Conti  ^7]  and  it  degen¬ 
erates  to  Conti's  theorem  when  T.  is  a  unit  ball. 

Our  results  for  T.-null  controllabilitv  at  (x  ,t  )  have  even  wider  appli- 

o  o  r 

cability  since  they  do  not  require  0  €  T. .  Neither  do  they  require  the  existence 
* 

of  a  u  €  ft  such  that  3u  •  0  as  in  ^7j-fl23.  Thus  we  can  analyze 

controllability  of  a  system  with,  for  example,  m  ■  1  and  T.  •  rl,23  whereas  many 
of  the  presently  available  theorems  do  not  apply.  Furthermore,  as  will  be  illus¬ 
trated  by  examples,  there  are  autonomous  systems  (S)  which  are  neither  globally 
T.-null  controllable  nor  locally  T.-nuil  controllable  but  nevertheless  are  T.-null 

controllable  at  some  (x  , t  ).  Our  theorem  can  be  used  to  decompose  the  state 

o  o 

space  into  two  sets.  Initial  states  in  one  set  can  be  steered  to  the  origin 
while  those  in  the  other  cannot  be  driven  to  the  origin  by  an  admissible  control. 

2.  Main  Results.  In  order  to  describe  our  necessary  and  sufficient  con¬ 
ditions  for  global  T.-null  controllability,  we  make  use  of  the  support  function 
H_  :  ■*  R  U  f+  ■)  on  T.  which  for  any  j  f  R31  is  given  by 

lU(or)  *  supfjj’o  :  *  6 

Using  this  notation,  we  have  the  following  theorem,  which  is  proven  in  Appendix  A 

f 

Theorem  2.1.  Suppose  T*  _■  compact  set  which  contains  zero  .  Then,  (S)  is 
globally  T.-nul  1  controllable  JL_f  and  only  if 

.■ 

(2.1)  lU(B’(T)z(T))dr  •  *  m 

'  t  “ 
o 

for  all  non-zero  solutions  z  ( • )  of:  the  ad  joint  system 
(S')  i(t)  -  -A' (t)z(t) ;  t  €  [c0,-)  , 

♦ - 

The  theorem  Is  also  valid  if  the  requirement  "0  €  T."  is  replaced  with  "there 
exists  a  u  €  T.  such  that  Bu  *  0".  This  type  of  assumption  is  used  by  Branmer  '4* 
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or  equivalent Iv .  if  and  only  if 


sup{'i! '  B ' (t  )$ ' (t  ,t  )X  :  l  € 


for  all  X  €  Rn,  \  »  0. 

We  note  chat  (3 ' (t  )  z  (r ) )  can  be  viewed  as  the  composition  of  a  non- 
negative  3aire  function  with  a  measurable  function.  Hence,  the  integral  in  (2.1) 
is  well  defined  along  all  trajectories  z(*)  of  (S) . 

In  the  following  corollary,  we  examine  the  special  case  of  Theorem  2.1 
which  arises  under  the  strengthened  hypothesis  "zero  is  an  interior  point  of 
fl."  As  we  might  anticipate,  for  this  special  case,  the  structure  of  the  set 
“  will  not  matter  ocher  than  the  requirement  that  it  contains  zero  in  its 
interior. 

Coro  liar.’  2.2.  (See  Appendix  A  for  proof):  Suppose  there  exis  ts  a  com¬ 
pact  sec  T.  such  chat 

(i)  zero  is  an  Interior  point  of 

(ii)  (S)  .i£  globally  r.-nul  1  controllable. 

Then  (S)  is  also  globally  f. '-null  controllable  for  anv  other  sec  fl'  (not  neces¬ 


sarily  compact)  which  contains  zero  in  its  interior. 


Our  proof  of  Theorem  2.1  will  make  use  of  a  more  fundamental  result  (also 

proven  in  Appendix  A)  giving  conditions  for  r.-null  controllability  at  a  fixed 

initial  epoch  (x  ,t  ).  To  meet  this  end,  we  define  the  scalar  function 
o  o 

J  :  Rn  *  R  x  Rn  •*  R  bv 


(2.2) 


A 

J(x  ,T,\)  ft  x':'(T,t  )\  -  H«  (B ' (t  )C  '  (T  ,t  )\)dr 


We  note  that  J(x  ,T,X)  can  be  viewed  as  the  support  function  on  the  so-called 
o 

attainable  set.  This  fact  is  used  implicitly  in  the  proof  of  the  next  theorem. 

Theorem  2.3.  Le t  T.  be  a  compact  set .  Pick  any  subset  o^.  Rn  which  contains 
Omm  Interior  point.  Then  (S)  _ijs  ."-null  control  lable  at  (xq,  tQ)  _if  and  only  _if 

(2.3)  ain{ J(x  ,T,X)  :  X  €  -  0 

o 

for  some  T  €  ^t^,»),  or  equivalently,  if  and  onlv  if . 

(2.4)  J(xo,T,\)  a  0  for  aU  X  €  A 
for  some  T  €  ^ tQ ,») . 

Comment .  If  .1  is  also  convex  and  A  and  3  are  constant,  the  sufficiency 
portion  of  this  theorem  is  Just  a  special  case  of  Theorem  7.2.1  of  [6]. 

Naturally,  the  smallest  time  T  for  which  (2.3)  holds  will  be  the  minimum  arrival 
time  at  the  origin. 

Theorem  2.3  can  also  be  stated  in  terms  of  the  adjoint  system  (S'),  i.e., 

if  we  take  \  -  Rn  and  notice  that  z(t)  -  ;'(t  ,t)z(t  )  is  the  response  of  the 

o  o 

adjoint  system  (S'),  then  the  following  theorem  is  easily  proven.  (The  proof  is 
established  by  making  the  change  of  variables  z(t)  ^  i'(T,t)X). 

Theorem  2.3'.  Let  "  satis  fy  the  hvpothes is  of  Theorem  2.3.  Then  (S)  is 


that 


,T 

(2.5)  x'z(t  )  a-  tU  (B '  (r  )z  (t  )  )d-r  s  0 

o  o  .  .. 

o 

for  all  solutions  z ( • )  ol  (S'). 

This  theorem  demonstrates  that  the  question  of  fi-null  controllability  at 
(xo,tQ)  can  be  answered  by  solving  a  finite  dimensional  optimization  problem. 
Moreover,  the  question  of  global  T.-null  controllability  can  also  be  answered 
via  a  finite  dimensional  optimization  problem. 
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Corollary  2.4.  Let  7l  and  A  be  as  _in  Theorem  2.3.  Then  ( S )  _ls_  gig*-  ally 

r.-nul  1  control  lab  le  .at  t^  and  onlv  If  for  every  x^  €  Rn  there  la  a  time 

T  €  rc  ,»)  such  that 
o 


ain(j(xo>Tx  ,X)  :  \  €  M  -  0  . 

o 

The  proof  of  this  corollary  follows  from  Theorem  2.3  In  conjunction  with 
che  definition  of  global  .“.-null  controllability. 

There  is  one  point  worth  noting.  In  using  Theorem  2.1  to  check  for  f.-null 
controllability  at  t^,  T.  must  be  compact  and  contain  0.  If  Corollary  2.4  is 
used,  only  the  compactness  assumption  must  be  satisfied. 

Next,  we  present  some  examples  to  illustrate  how  our  theorems  can  be 
applied  and  to  compare  our  results  to  chose  of  "3-53. 

Example  .  Let  x(t)  and  u(t)  be  scalars  and  suppose  (S)  is  described  by 

*(C)  -  x(t)  *  u(t)  ,  t  €  ^0,«)  . 

This  system  is  R‘-null  controllable  if  “  -  R'.  But  suppose  ?.  -  "0,1..  Ther.  tne 

svstea  is  not  globally  .T-null  controllable  at  t  *0.  This  follows  from 
7  -  5  7  o 

•*  v 

Theorem  2.1  since,  for  2  <  0,  R„  (B ' (t  )  *  (r  ) )  •  0  and  thus  H_  (B ’ (t  )z  (t  )  dr  <  4-  « 

o  %  w  / 

o 

Also,  using  "3*  or  [4*  it  can  be  shown  that  the  system  is  not  locally  fi-null 

controllable.  Neverthe ’ ess ,  there  do  exist  inicial  states  x  from  which  it  is 

o 

possible  to  steer  the  system  to  the  origin.  Such  states  can  be  determined  via 
Theorem  2.3. 


For  the  above 


T  *T  T-t 

J(x  ,T,X)  •  x  e  V  i  supfxe  V  :  x  €  ’’O.l^d-r 
O  O  J  _ 


Vhen  ,*.  •  r-l,l3,  this  becomes 


J(xo,T,\) 


x  e  X 
o 


x  eTX  *  X  (e  l) 
o 


x  <  o 


X  >  0 
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and  thus 


alnU<xo,T,>.)  :  X  €  -  0 

if  and  onlv  if  x  <0  and  x  2  e  *-  1  for  some  T  €  r0,»),  or  equivalently ,  if 
o  o 

and  only  if  -1  <  x^  £  0.  Vie  conclude  that  even  though  (S)  is  not  locally  l>nuli 

controllable,  it  is  “-null  controllable  at  (x  ,0)  whenever  -1  <  x  £  0. 

o  o 

If  T.  -  rl,2*,  neither  ^3-5*  nor  Theorem  2.1  apply.  However,  we  can  use 
Theorem  2.3.  Since 


J(x  ,T,X)  becomes 
o 

J(xo.T,X)  - 

and 

min{ J(x  ,T,X)  :  X  €  [-l.l]!  -  0 
o 

if  and  onlv  if  2(e'r-  l)  £  x  £  1.  Thus  (S).with  .“  -  >"1,2', is  fl-null  con- 

o 

troilable  at  (x  ,0)  whenever  -2  <  x  £  0. 

o  o 

As  a  final  variation  of  this  problem,  suppose  f,  -  ^-a,a'.  Then  '4.  or 
Theorem  2.1,  shows  that  (S)  is  not  globally  .“-null  controllable.  Using  '4^, 
it  can  be  demonstrated  that  (S)  is  locally  f.-null  controllable  while  Theorem  2.3 
not  only  tells  us  that  (S)  is  locally  T.-null  controllable  but  also  that  the  states 

x  which  can  be  steered  to  the  origin  are  those  satisfying  -a  <  x  <  a. 

o  ° 

Example  2.  Our  second  example  illustrates  the  application  of  Theorem  2.1 
for  a  non autonomous  system.  We  consider  the  time-varying  two-dimeas ional  system 


x  ♦  2X(eT-  l)  X  >  0 

o 


x  e  *X  *  X(eT-  1)  X  £  0 

_  o 


(S)  described  by 


*^(C)  •  a(t)«lnt 


*2(c) 


<c+l) 


T  XjU)  +  u(t)tsint,  t  €  ro,-) 


Th<  control  constraint  set  is  taken  to  be  ^  0 , 1 3 .  By  a  s traightf orvard  com¬ 
putation,  the  state  transition  matrix  for  the  adjoint  svstea  (S')  is  found  to  be 

r  «.«  i 


(t+l)(co^l) 


:#(c,t  ) 


o  i 


Hence,  in  accordance  with  Theorem  2.1,  (S)  is  globally  f.-null  controllable  at 


t  ■  0  if  and  only  if 

o  ' 


7  r  7 

.»  1  -I—  \i 

sup  *Tsin  t  rsln  t'  *L  .  fa  m  +  * 

•o  «e-0,i:  ■  |_o  iJ_«02j 

for  al  1  r.nn-re-c  initial  conditions  2^  a  z3'>-'*  Evaluating  above,  this 


sup 

*o  wgro.i: 


fa  • 


reduces  to  the  requirement  that 


(2.6) 


'  I  (t  )  dr  k  ' 


aax  ' 0,Z01  iln  r  +  t  s  in  t  ( 1  *  ’  dr  •  * 


for  all  2^  *  0.  We  shall  show  that  this  condition  is  indeed  satisfied. 

Case  1 .  2^  *  0,  2q,  •  0.  For  this  case,  we  have 

«*  .» 

I (r  )dr  -  aax ’ 0 ,  sintldr 

o  *o 

-  j  *0l  Un  t  dr 
°l 

where  ■  (r  s  0:  sin  r  >  0”! .  Because  the  range  set  "j  of  integration  is 

the  union  of  infinitely  many  Intervals  of  length  **,  it  follows  that 


I  (t  )d»  •  *  ■ 


o 


Case  2.  z  ^ ^  •  anything,  z ^ 
(2,6),  it  surficies  to  show  chat 


Lee  T 


llsiLli. 
'  Z02^ 


Then  to  verify 


A 

I  (t  )  dr  •  ♦  « 

*  om 
°2 

where  S,  ■  'r  2  T  :  z^,  sin  r  >  03  .  (Recall  chat  the  integrand  is  non-negative.) 
Now,  for  r  e  ,  we  notice  that  the  integrand  I(r)  can  be  bounded  from  below  as 

A 

follows : 


VlnT  +  zo 


2t  s In  r ( l  ♦  a  lr02"sin  r!f.  I  +  *  l*0lllsinT| 

a  (' *02'  T  -,I0l,',>lB  T' 

2  (' *02’  T*-'roi0'sin  T’ 


Hence , 


■  I  s in  t  1 


!•  1* 

I(t)<>t  2  >  s  in  t  [  dr  •  *  * 

m  09  *09 

«2  °2 

because  the  range  of  integration  is  once  again  the  union  of  infinitely  many 
intervals  of  length 

We  conclude  that  (S)  is  globally  T.-null  controllable. 


3,  Relationship  with  Other  Controllability  Results.  In  this  section,  we 
compare  our  controllability  results  with  those  of  Conti  ^7'  and  Branmer  [4],  We 
also  consider,  as  a  limiting  case  of  our  theory,  the  usual  controllability  problem 
obtained  when  magnitude  constraints  are  not  present. 

Result  of  Conti.  An  important  special  case  of  Theorem  2.1  occurs  when  ft  is 

!D 

a  closed  unit  ball  in  R  ,  i.e., 

ft  -  (.  €  Ra  :  U'  *  1) 


where  *  is  a  prespecified  norm  on  R*.  For  this  situation  we  have 


— 
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^(B'(t)s(t))  -  sup{  jj  '  B ' (t  )z  (t  )  :  M  |  i  1}  •  ||  B ' (t  )*(t  )|!  w 

where  •  \  Is  the  norm  on  Rm  which  is  dual  to  .j|  .  (For  example  ^  is  Che 

2 *  norm  when  is  Che  2*  norm;  and  «'  coincide  when  *  is  che  usual 
2 

2“  (Euclidean)  norm.) 

By  Theorem  2.1,  we  conclude  chat  (S)  is  globally  D-null  controllable  at 

C  if  and  only  if 
o 

«• 

(3.1)  B'(T)t(T)i'  dr  -  4.  - 

“  t 

o 

for  all  non-zero  solutions  z(*)  of  (S').  This  resulc  is  established  indepen¬ 
dently  in  Conti  [7[  and  also  discussed  in  Pandolfi  [82.  This  result,  in  con¬ 
junction  with  Corollary  2.2  leads  immediately  to  the  following  Proposition. 

Proposition  3.1.  Let  ?,  be  anv  set  containing  zero  in  its  interior.  Then 
(3.1)  _i£  a  necessary  and  sufficient  condition  for  global  f.-null  controllability. 

Thus,  Conti's  condition  is  a  necessary  and  sufficient  condition  for  global 
r.-null  controllability  for  any  set  fl  containing  zero  in  its  Interior,  not  Just 
when  T.  is  Che  closed  unit  ball. 

Resulc  of  Bremer.  Consider  che  case  when  A(t)  ■  A  and  B(t)  ■  B  are  time- 
invariant.  For  these  autonomous  problems,  the  following  necessary  conditions 

can  be  obtained  directly  from  Theorem  2.1.  Recall  that  Q  •  [B,AB . A°  ^Bj. 

Theorem  3.2.  Assume  A(t)  ■  A  and  3(C)  ■  B  are  t lme- invariant  and  that 
"  Is  a  compact  set  which  contains  the  origin.  (S)  ±3.  globally  .*> null  con¬ 

trollable  then 
(1)  rank  (Q)  •  n 

( i i )  there  is  no  real  eigenvector  v  ot^  A'  satisfying  v ' Bui  <  0  for  all  w  €  f» . 
(Hi)  no  eigenvalue  of  A  has  £  positive  real  part . 

The  proof  of  this  resulc  is  in  Appendix  B. 


In  ^4^,  Brantner  has  obtained  the  saoe  result  using  a  different  method  of 
proof.  There,  he  also  shows  that  the  above  three  conditions  are  also  sufficient 
for  global  T.-null  controllability  in  the  time  invariant  case  if  it  is  also 
assumed  that  the  convex  hull  of  I)  has  a  non-empty  interior.  Alternative  proofs 
of  the  sufficiency  result  have  been  given  by  Heymann  and  Stem  *[25*  and  Rajek. 

The  latter  proof  is  in  [5^. 

We  note  that  the  system  of  Example  1  of  Section  2  does  not  satisfy  these 

three  conditions.  Nevertheless,  it  is  r.-null  controllable  at  (x  ,0)  for  some 

o 

initial  states  x  . 

o 

The  Case  OR3.  When  OR3,  it  Is  well  known  ^17,  p.  171*  that  the  time- 
varying  system  (S)  is  completely  controllable  (globally  Ra-null  controllable  at 
tQ  in  our  notation)  if  and  only  if  the  rows  of  2(to>*)3(*)  are  linearly  indepen¬ 
dent  on  some  bounded  Interval  ^tQ,Tl.  Here  we  show  that  when  OR3,  equation  (2.1) 
is  a  necessary  and  sufficient  condition  for  global  R3-null  controllability.  This 


is  accomplished  by  shoving  that  (2.1)  is  equivalent  to  the  rows  of  $(to>*)B(*) 
being  linearly  independent  on  some  bounded  interval  ’[t^.T^. 

Proposition  3.3.  (S)  _i£  globally  R3-nul 1  control  I  able  if  and  only  if 

H  (B ' (t  )r  (t  )  dr  -  ♦  • 

*  t  R3 
o 

for  all  non-zero  solutions  z  ( • )  o_f  (S') . 

The  proof  of  this  result  is  in  Appendix  B. 

U,  Some  Computational  Aspects.  In  a  large  number  of  problems,  one  may 
have  to  resort  to  the  cosgmter  to  check  whether  or  not  a  system  is  fi-null  con¬ 
trollable.  When  using  equation  (2.3),  a  solution  of  the  minimization  problem 

•nin' J(x  ,T,X ) :  X  €  M  is  needed.  Direct  application  of  so-called  gradient  or 
o 

descent  algorithms  to  compute  min{ J(xo,T,X) :  X  €  .'.1  is  precluded  by  the  fact 

that  J(x  , T,X )  is  in  general  not  differentiable  in  X.  This  fact  is  a  consequence 
o 
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of  che  sup  operation  involved  in  Che  definition  of  H^(B' (t )t  ' (T,r )X) .  Fortunately, 

14 

however,  numerical  computation  of  minf J(xq,T,X) :  X  £  ,\1  is  feasible  if  "generalized 
steepest  descent"  schemes  are  used.  These  schemes  rely  on  subdifferencial  rather 
chan  gradient  information.  The  next  two  lemmas  develop  a  description  of  the  sub- 
differential  of  J(x^,T,X).  The  proofs  are  given  in  Appendix  C. 

Lassaa  4.1,  For  fixed  (x  ,T)  €  Rn  x  R,  J(x  ,T,X)  is  a  lower  semicontinuous 
_  1  ■  “  o  o  "  1  — ■ 

convex  function  of  X . 

Lemma  4.2.  For  fixed  (x  ,T)  €  Rn  x  R,  the  subdifferential  of  J(x  ,T,*)  at 

— _  — —  — —  o  -  -  ■  ■  — “  o  ““ 

X  €  R°  cons  ists  of  all  vectors  X#  €  Rn  of  the  form 

rT 

(4.1)  X*  -  »(T,to)xo  *  j  2  (T,r  )B (t  >u^(t  )dT 

Co 

where 

(4.2)  i)*(T)  €  arg  max(x  ' B ’  (r  )C  '  (T ,r  )X  :  x  € 

-  (<«  €  a  :  x,a'(r)C'(T,r)X  a  ?  B '  (r  >C  '  (T,r  )X  V  1)  6  fll 
for  almost  all  r  €  ”0,Tj. 

Remark.  Since  J(x  ,T,X)  is  Che  support  function  on  the  attainable  set  (see 
—————  o 

discussion  preceding  Theorem  2.3),  a  geometric  interpretation  of  the  subdif ferentiai 
at  X  is  available:  This  set  consists  of  all  vectors  in  the  normal  cone  to  the 
attainable  set  at  X.  (See  Goodman  *[24,  p.  295*). 

Formulae  (4.1)  and  (4.2)  hold  for  arbitrary  coti^>  act -convex  Q.  Often  however, 
more  structural  information  is  known  about  D.  In  such  cases,  (4.1)  and  (4.2)  may 
simplify.  To  illustrate,  suppose 

7 - 

X  €  >J(x  ,T,X),  the  subdifferential  of  J(x  ,T,*)  at  X ,  if  and  only  if 
♦  o  o 

J(x  ,T,s)  as  J(x  ,T,X )  *  (z  -  X)‘X*  for  all  z  €  Rn  . 

0  0 
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0  -  X  <[.^,>^2  x  ...  x  ;  (M^  >  0) 

Th«n,  the  maximum  in  (4.2)  is  achieved  in  Che  iC^  cooponenC  by 

0%(t  )  agnrB' (r  )e  1  (T,t  )\]l  ;  1  -  1,2,... ,m 

where  sgn  x  i  1  if  x  >  0;  sgn  x  A  -1  if  x  <  0;  sgn  0  ^  f - 1 , 1 3 •  Consequently ,  for 

this  case,  we  can  substitute  into  (4.1)  and  show  that  the  subdifferencial 

5 J(x  ,T,X)  consists  of  all  vectors  X^  €  Rn  of  the  form 
o  * 

rT  m 

(4.3)  X*  -  $(T.0)xo  ♦  I  Mth  (T,r)sgn  X'h  (T.rjdv 

‘  o  i«l 

where  h^(T,r)  is  the  lC^  column  of  H(T,t)  ^  3(T,t)B(t).  This  description  of  the 
subdlf ferentials  of  .Kx^.T,*)  can  be  used  in  conjunction  with  the  generalized 
steepest  descent  algorithms  to  compute  min{ J(xo,T,X) :  X  €  Al . 

We  also  note  that  X#  is  uniquely  specified  by  (4.3)  if 

measure^  :  X’h^(T,r)  •  03  ■  0  for  i  ■  1,2 . m 

For  such  X,  3J(x  ,T,X)  is  precisely  7.  J(x  ,T,X),  the  gradient  of  J(x  ,T,*)  at  X. 

O  K  O  O 

5.  The  Steering  Control.  Using  the  results  of  Section  2,  we  can  determine 
if  (S)  is  D-null  controllable.  However,  those  results  do  not  give  a  method  for 
determining  a  steering  control  u^(*)  €T.(r.)  which  acconq>llshes  this  objective. 

One  method  of  determining  an  appropriate  u#(*)  is  to  solve  the  time  optimal 
control  problem,  i.e.,  find  u#(*)  €T.(f.)  which  steers  (S)  from  given  (x0>c0)  to 
Che  origin  and  docs  so  in  minimum  Cine.  If  there  is  a  control  which  steers  the 
system  to  the  origin,  then  there  is  a  time  optimal  one  [2j.  Hence,  in  principle, 
a  steering  control  can  be  numerically  computed  using  any  of  a  wide  variety  of 
algorithms  which  are  available  for  solution  of  Che  time  optimal  control  problem. 

Since  Che  solution  of  the  time  optimal  problem  is  determined  by  solving  a 
two  point  boundary  value  problem,  it  can  be  quite  difficult  to  obtain  the  steer¬ 
ing  control  this  way.  In  this  section,  a  "simpler"  alternative  method  for 
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generating  a  steering  control  is  presented.  This  technique  does  not  involve  a 
two  point  boundary  value  problem  and  leads  to  a  control  which  steers  the  system 
arbitrarily  close  to  the  origin.  Our  result  is  obtained  from  the  following 
minimum  norm  problem:  Given  initial  point  (X0>CQ)  and  a  final  time  T,  find 

u(*)  €  which  leads  to  the  smallest  value  of  x(T)1  .  The  solution  of  this 

minimum  norm  problem  is  characterized  in  the  next  theorem. 

Theorem  5.1.  (See  Appendix  D  for  proof).  Let  (x^t^)  and  T  be  given. 
Suppose  chac  €  R°  achieves  the  minimum  of  J(x^,T,\)  over  the  clos ed  unit  ball. 
Then  any  solution  of  the  minimum  norm  problem  satlsf les 

(5.1)  u^(t)  €  arg  maxjju '  B ' (t  )fi  '  (T,r  )\#  :  jj  €  f/l 

for  almost  all  r  €  rt  .T!. 

- -  -  o 

We  note  that  condition  (5.1)  will  uniquely  determine  u^(-)  whenever  the 
minimum  of  a  '3 ' (t )C ' (T,t )\  is  uniquely  achieved.  For  example,  suppose 

.i  -  c -tv*,: « c-Hj.iij: » >  °>  ■ 

Then  (5.1)  requires 

(5.2)  [u#(t)j1  6  M^gn^B'  (r)c'  (T,r  )\itll  ,  i  •  1,2 . m. 

For  the  case  when  the  minimum  of  x(T)|  ■  0,  »  0  and  (5.1)  will  not 

determine  a  control  which  steers  (S)  to  the  origin.  The  following  heuristic 
procedure  can  be  used  to  determine  a  control  which  steers  (S)  arbitrarily  close 
to  the  origin:  Choose  a  T  such  thac  the  minimum  of  x(T)1  is  nonzero.  As  T  is 
Increased,  the  minimum  of  x(T)i'j  approaches  zero  and  the  corresponding  solution 
u*(’),  generated  via  (5.2),  of  the  minimum  norm  problem  results  in  a  control 
which  steers  the  system  progressively  closer  to  the  origin. 

(S)  here  is  required  to  be  Rm-null  controllable. 
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In  our  next  theorem,  we  provide  another  useful  characterization  of  steering 

controls.  For  fixed  T  €  r0,»),  x  €  Rn,  we  define  the  functional  V  •  Rn  *  -*  R 

o  I 

by 

rT 

V_(X  ,u( • ) )  •  X'3(T,0)x  +  X*a  (T ,r  )B (t  )u(t  )dr 

T  0  ‘  0 

Theorem  5.2.  (See  Appendix  D  for  proof).  Pick  anv  compact  convex  set  A  con¬ 
taining  zero  as  an  interior  point.  Then  V^(X ,u( • ) )  possesses  at  least  one  saddle 
point  (X^.u^-))  6  A  x  Moreover  ,u*(  • )  steers  xq  to  zero  at  time  T  i£  and 

onlv  if  Vj,(\#,u#(-))  ■ 


0. 
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6.  Additional  Applications.  In  this  section,  we  use  our  results  to  obtain 
an  existence  theorem  for  the  time  optimal  control  problem  and  also  apply  our 
results  to  a  pursuit  game. 

Existence  of  Time  Optimal  Controls.  Consider  the  following  time  optimal 

control  problem:  Find  u(-)  €"h(r.)  which  drives  the  state  x(’)  of  (S)  from  an 

initial  position  x(t  )  ■  x  to  the  origin  and  minimizes 

o  o 

.Cf 

C(u(*))  ■  dt  ;  c,  ■  arrival  time  at  the  origin. 

*t  £ 

o 

The  classical  theorem  for  existence  of  a  time  optimal  control  (e.g.,  Lee  and 

Markus  [2])  requires  that  there  Is  at  least  one  control  which  transfers  the 

state  x(*)  of  (S)  to  the  origin.  Combining  the  result  of  [2]  with  our  Theorem  2.3, 

we  obtain  the  following  existence  lemma. 

Lean  a  6.1.  There  exists  a  solution  to  the  time  optimal  control  problem  If 

and  onlv  if  there  Is  some  finite  t,  €  "t  ,» )  such  that 
'  "  “ '  “  ”  —  '  t  *  o  ——  - 

min{ J(xQ,t^,X)  :  K  €  •  0 

Furthermore .  the  time  optimal  cos t  is  given  by 

C*(u*(-))  •  mln{tj  :  min£ J (xq , t^ ,\ )  :  X  €  Aj  •  0) 

Pursuit  Games.  Next,  we  consider  the  pursuit  game  studied  by  Hajek  [18], 

The  system  Is  described  by 

(6.1)  *(t)  -  Ax(t)  -  p(t)  ♦  q(t)  ;  p(t)  €  P  ,  q(t)  €  Q  x(tQ)  -  xq 

where  P  and  Q  are  compact  convex  subsets  of  Rn.  The  pursuer  p(*)  seeks  a 
strategy  r  :  Q  *  [tQ,»)  "*  p  which  steers  x(.)  to  the  origin  for  all  possible 
quarry  controls  q(-)  :  •*  Q.  A  quarry  control  Is  admissible  if  it  is 

measurable  and  a  strategy  Is  admissible  If  ?(•)  preserves  measurability. 
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In  [18" ,  a  solution  to  this  problem  Is  obtained  In  terms  of  the  associated 
control  system 

(6.2)  y (t)  -  Ay (t)  -  u(t)  ;  u(t)  €  P  -  Q  ;  y(t  )  -  x 

o  o 

★ 

where  P  -  Q  Is  the  Pontryagln  difference,  l.e., 

P  •  Q  ^  [x  €  Rn  :  x  +  Q  c  pi  . 

Admissible  controls  u(')  above  must  be  measurable. 

Simply  put,  Hajek's  result  says  that  the  state  x(-)  of  (6.1)  can  be  forced 
to  the  origin,  for  all  admissible  q(-),  If  and  only  If  the  state  y(*)  of  (6.2) 
can  be  steered  to  the  origin.  More  precisely,  the  following  theorem  Is  available 


s  trobos  coo  leal  lvl  forced  co  Che  origin  at  time  T  i  c0  ±  s  trategy  z  ( •  )  If 
and  only  If ,  ^n  (6.2)  can  be  s ceered  to  the  origin  at  time  T  bv  an  admissible 
control  u(*).  Furthermore ,  C(-)  and  u(*)  are  related  bv 

(6.3)  ?(q,C)  -  u ( t)  +  q  . 


3y  applying  Theorem  2.3  to  (6.2),  we  obtain  another  condition  for  deter¬ 
mining  If  (6.1)  can  be  forced  co  the  origin. 

♦  n 

Leaiaa  6,2.  As s ume  ?  -  Q  compact.  Pick  any  subset  f,  of  R  containing  zero 

as  an  Interior  point .  Then  xq  _in  (6.1)  can  be  forced  to  the  origin  at  time 

1st  bv  a  strategy  - ( • )  if  and  onlv  If 

alnf K(xq,T,X)  :  X  €  M  •  0 


where 


K(xo,T,X)  &  x^e 


A'(T  ‘  crt>  *T  awt.t! 

°  \  *  H_jQ(eA  (T  T)X)dr 

o 
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It  should  be  pointed  out  that  in  addition  to  pursuit  game  interpretation 
of  (6.1),  (6.1)  can  also  be  viewed  as  a  problem  of  steering  a  system  with  dis¬ 
turbances  to  the  origin  if  q(>)  is  thought  of  as  a  disturbance.  Also,  the  results 
apply  to  systems  described  by 

*(t)  -  Ax(t)  +  Sp(t)  +  Cq(t)  ;  p(t)  €  P  ,  q(t)  €  Q 
if  one  replaces  3p(t)  by  p'(t),  Cq(t)  by  -q'(t),  P  by  BP  and  Q  by  CQ. 


20  - 


APPENDIX  A 

Proof  of  Theorems  2.1,  2.3  and  Corollary  2.2.  Since  Theorem  2.3  is  used  in  the 

proof  of  Theorem  2.1,  we  first  present  the  proof  of  Theorem  2.3.  There  are  many 

ways  to  prove  Theorem  2.3;  our  proof  exploits  the  convexity  of  the  attainable  set 

in  conjunction  with  a  measurable  selection  theorem.  We  note  that  a  proof  of  the 

sufficiency  part  of  the  theorem  is  given  in  '6,  Theorem  7.2.1*.  To  simplify  our 

notation, we  henceforth  cake  t  ■  0  without  loss  of  generality.  This  will  apply 

o 

to  subsequent  appendices  as  well. 

Proof  of  Theorem  2.3.  Let  A_(x  )  be  the  sec  of  states  which  can  be  attained 

-  I  o 

from  x  at  time  T,  i.e., 
o 

(A.  1  >  A_(x  3  -  '*(T,0)x  +  S(T,t  )B(t  )u(t  )dx  :  u<>)  €!A  . 

:  o  o  w  l 

o 

The  set  A^(x^)  is  convex  and  compact  r2*.  From  Def.  1.1,  it  follows  that  x^  can 
be  steered  to  0  at  time  T  if  and  only  if  0€A^(x^)  or,  equivalently,  by  the  Separating 
Hyerpiane  Theorem  *21*, 

(A. 2)  0  *  sup*\'a  :  agA^ix^)- 

for  all  vectors  \  €  Rn.  Using  (A.l),  requirement  (A. 2)  becomes 

rT 

(A. 3)  '  '2(T,0U  *  sup-  '  V  ’S(T,t  )B(r  )u(t  )dr  :  u(*)  €7*  CT2)  K  >  0 

O  %  J 

o  ! 

for  al.  \  €  As  a  consequence  of  the  measurable  selection  theory  of  *19.,  we 

* 

can  cociaute  the  supremum  and  integral  operations  in  (A. 3)  .  Thus,  0  €  A^x^)  If 
and  only  if 

.T 

(A.4^  0  <  \’:(T,0)x  *  R.(B’(T)S'(T,T)\)dT  -  J(x  ,T,M 

O  •  .4  o 

0 

for  all  ‘  €  R\  Since  J(x  ,T,\)  is  positively  homogeneous  in  we  can 

o 

restrict  \  to  ^  in  (A. 4).  Theorem  2.3  now  follows.  Z 

;(T,t)  3 (t )  being  a  Cartheodory  function  enables  us  to  apply  the  results  of  *192. 
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Next,  we  present  the  proof  of  Theorem  2.1.  In  the  proof.  Theorem  2.3  Is 

used. 

Proof  of  Theorem  2.1  (Necessity):  We  suppose  chat  (S)  is  globally  T.-null 

controllable  at  c  ■  0.  Let  z(-)  be  anv  non-zero  solution  of  (S');  we  must 
o 

prove  that 


<  0 
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Taking  t.  ■  R  in  Theorem  2.3,  it  follows  that 


minf  J(x  ,t,X)  :  X  €  M  <  J(x  ,t,X„)  <  0 
o  o  c 

★ 

for  all  c  €  0,»).  3v  Theorem  2.3,  (S)  is  not  T.-null  controllable  at  (x  ,0), 

Q 


(Sufficiency):  Now,  we  assume  that  (A.S)  holds.  Again,  we  proceed  by  con* 

tradiction,  t.e.,  suppose  (S)  is  not  globally  Tj-null  controllable  at  t  ■  0. 

* 

Hence,  there  exists  an  initial  condition  x  *  0  which  cannot  be  steered  to  zero. 

o 

3y  Theorem  2.3  (with  •  Rn) ,  we  can  find  a  sequence  of  times  a 

OB 

sequence  of  vectors  ^*vin8  c^e  following  properties: 


PI.  lia 

k  -•  * 


Sc  "  +  * 


>2.  J(x  ,t^,X.)  <  0  for  k  •  1,2,3... 


We  are  going  to  construct  an  initial  condition  "S  *  0  for  (S')  which  makes  the 
integral  in  (A. 5)  finite.  To  meet  this  end,  let 


a'<VQ>S, 

!!o'<tv,°)xk. 


,  k  •  1,2,...  , 


We  note  that  each  above  is  non-zero  because  X^  *  0  and  j(t^,0)  is  Invertible, 
Then  ( is  *  sequence  in  Rn  belonging  to  the  set 

S  »  («  C  «”  :  "rf  -  11  . 


Since  S  is  compact,  we  can  extract  a  subsequence  ( z^  }  ^  which  converges  to 

seme  vector  1  €  S.  We  will  now  show  that  1  is  the  initial  condition  which 

o  o 

we  seek.  Let  z(*)  be  the  trajectory  of  (S')  generated  by  z(0)  zq;  let  ( t^ 


denot 


e  the  subsequence  of  times  corresponding  to  ( z^  •  By  Pi.  we 


have 


1 1m  t,  •  ♦  • 

j->  kj 

and  bv  p2,  1c  follows  chat 

x*'5'(t  ,0)X.  *  R.(8'(t)9'(t.  ,T)\.  )dr  <  0  for  j  -  1,2,3.... 

O  iC.  iC.v  •«  •*  .  ^  . 

J  J  O  J  J 

Dividing  by  j'(t.  ,0)\  and  noting  that  H-  is  positively  homogeneous,  we 

K .  iC .  •« 


obtain 


0.(B‘  (t)o’  (0,t)z  )<Jt  <  x*  z  _for  j  -  1,2,3,,.. 


<  x*  for  J  ■  1,2,3,... 

a  ““ 

We  would  like  to  obtain  an  inequality  involving  z  with  an  infinite  upper  limit 
on  this  integral.  To  accomplish  this,  we  define 


f.  (t)  i  H_  (3 ' (t  )c  '  (0 ,r  ) z,  )  if  r  €  [O.e.  *.  ; 

J  U  J  J 

•  0  otherwise;  J  -  1,2,3,...; 
f  (t  )  ^  h_(3'(t)S'(0,t)zo)  ;  t  €  '0,-) 

and  make  the  following  observations; 

*"  * 

(i)  f,  (r)dT  is  bounded  (bv  x  )  for  j  •  1,2,3,... 

.  k ,  o 

o  J 

(il)  f,  (t  )  converges  polntwise  to  f  (t  )  on  [(),•).  This  observation  is 

j 

proven  using  the  facts  that  z.  ■*  z  ,  t,  -*  +  •  and  H_  depends  con- 

J  °  J 


tinuously  on  its  argument. 
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Applying  Fatou's  Lemma  ]20,  p.  83], we  have 


f(r)dT  s  l lm  Inf  f.  (t  )<1t 

k  K  . 

o  J  «•  •  o  j 


<  llm  *up  f^  (T)dT 

J  -  *  *  o  J 


*  lx*’ 
o 


Substitution  for  f  (r  )  above  gives 


HUB'  (t)c'  (0,r)z  )d*  <  x* 

*  'k*  0  0 

o 


l.e. , 


tU(B’(T)Z<T))dT  i  X* 


which  is  Che  contradiction  that  we  seek.  This  completes  Che  proof  of  the  theorem. 

Proof  of  Corollary  2.2.  Suppose  f*  and  f.'  satisfy  the  hypotheses  of  the 
corollary.  We  are  going  to  show  chat  (S)  is  globally  n'-null  controllable.  To 
prove  this,  it  is  sufficient  to  find  a  subset  £  n '  such  that  (S)  is  globally 
n'-null  controllable:  Pick  5  >  0  such  chat 

ft  {*:  all  *  51  C  a* 

(This  can  be  acccmplished  because  zero  is  interior  to  .V.)  Now,  to  prove  chat 
.“.j  has  the  desired  property,  we  pick  R  >  0  such  chat 

nR  ft  {a:  Hull  «  Rl  3  n 

(This  can  also  be  done  since  T.  is  compact,  hence  bounded.)  Let  *(•)  be  any 


non-zero  solution  of  (S').  Th«n  we  have 


o  "6 


•  sup{i)'B'  (t  )z(t  )  :  'ax'  S  ^dr 


-  4  I! B *  (t)z(t)|!  dT 


-  |  ^  Bl!  B  1  (t  )  z  (t  )||  dr 
‘  o 

6  f 


supfat '  B ' (t  )z (t  ) :  ,'a>|J  i  lOdt 


o 


"n  H«,  (B'(T)z(T))dr 

R‘o  **R 


■  + 


since  (S)  is  globally  f^-null  controllable,  (fl^-null  controllability  follows  from 
r.-null  controllability  in  conjunction  with  the  fact  that  r.R£T..)  3y  Theorem  2.1, 
we  conclude  chat  (S)  must  be  globally  f.^-null  controllable  and  hence  D'-null  con¬ 


trollable. 
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APPEND  LX  B 


Proof  of  Theorem  3.2.  (1):  This  condition  follows  immediately  from  the  fact 
that  global  Ra-null  controllability  is  necessary  for  global  f.-null  controllability. 

It  is  also  possible  to  prove  (i)  directly  from  Theorem  2.1.  Suppose  (S)  is 
globally  r.-null  controllable  but  rank  (Q)  <  n.  Then  there  exists  a  v  €  R°,  v  ^  0, 
such  that  B'e  A  Cv  •  0  for  all  t  2  0.  Let  z(0)  ■  v.  Then  z(t)  •  e*A  Cv  and 


.A-t 

sup  (ui '3  '  z(t  )  )dr  ■  sup  (<«' B'e  v)dr  •  0 


o  r. 


"  o  r. 


which  contradicts  Theorem  2.1. 

(11):  Suppose  (S)  is  globally  r.-null  controllable  but  there  exists  a  real  eigen¬ 
vector  v  of  A'  satisfying  jj'B'v  z  0  for  all  »  €  Q.  Denoting  by  X  the  real  eigen¬ 
value  associated  with  v,  we  have  e  A  Cv  •  e  * Cv.  With  z(0)  ■  v,z(t)  •  e  A  Tv  •  e  Tv 


sup  (n"i'z(j)6r  ■  sup 
*  o  »€  .*1  o  jj€  n 


sup  (ui’B’e  *Tv)dr 


e  *T  sup  ('jj'B'v)dr 


Now  this  Integral  is  less  than  or  equal  to  zero  since  sup  (ui'B'v)  z  0  and  e  2  0. 

j)€  r. 

This  contradicts  Theorem  2.1. 

(ill):  Again  the  proof  is  by  contradiction.  Assume  (S)  is  globally  fi-null  con¬ 
trollable  but  A  has  an  eigenvalue  X  with  a  positive  real  part.  Then  X  is  also  an 
eigenvalue  of  A'  so  that  A'v  •  Xv  where  v  is  an  eigenvector  corresponding  to  A1. 

Let  X  and  v  denote  the  complex  conjugate  of  X  and  v.  They  satisfy  Av  ■  Xv.  Hence, 


-A ' t  Xt  .  -A't-  Xt- 

e  v  ■  e  v  and  e  v  •  e  v 


Consider  the  solution  of  the  adjoint  equation  corresponding  to  the  initial  con¬ 
dition  t(0)  -  v  ♦  v.  (Note  that  s(0)  is  real.)  For  this  z(0) 


sup  (tu'B's(T)) 

<«  €  n 
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•  sup  (ui’B'e’A  T(v  +  v)) 

<n  €  Cl 

•  sup  r.u'B'(  «”'Cv  e~*  *7 

«  €  r. L  v 

•  sup  ^a'B'e  *tr2m  cos  be  +  2n  sin  be]* 

in  €  n  J 

where  a  and  b  are  the  real  pare  and  imaginary  pare  of  X  and  n  and  a  are  ehe  real 

pare  and  imaginary  pare  of  v.  Lee  M  ■  sup  sup  ai'BT2n  cos  be  *■  2n  sin  bt^. 

c  2  0  m  €  n 

M  is  f  inice  since  f?  is  co apace,  i.e. ,  Mi  2  aax[  |  n|  ,|aP  Bl  sup  'mil  .  Thus 

u»  €  n 

sup  (o»'B’*(t))  i  Me  *C 

u  €  0 


sup  (a> 'B 'z(t  ))dr  i  M  ;  e  dc 
*  o  <b  €  n  *  o 

The  incegral  on  che  right  is  f inice  since  a  >  0  and  we  have  a  contradiceion  co 
Theorem  2.1. 


Proof  of  Proposition  3.3.  (NecessiCy>:  Suppose  (S)  is  globally  R  -null 

conerollable .  Then  Chere  is  a  finite  interval  [0,T]  on  which  the  rows  of 

2(0,*)B(*)  are  linearly  independent.  Thus,  for  every  non-zero  vector  zq  €  Rn, 

it  follows  chat  8' (t)3 ' (0, t)z  d  0  for  some  t  €  rO,T].  Since,  B '(•)*' (0 ,* )z 

o  o 

is  continuous,  chere  aust  be  an  interval  I  •  rm  t  -  6  ,  t  t 2  on  which 

B ' (t )C ' (0 ,r ) z  d  0  for  all  t  €  I.  On  this  interval,  we  have 
o 

sup{'ji  B*  (t  )S '  (0,t)zq  :  x  €  R°^  ■  +  » 

Hence,  using  the  non-negativity  of  we  conclude  chat 


H  (B’(T)t(T))dT  2  H  (B ' (t  )C  '  (0  ,t  )  z  )dr 
*  o  R  ‘  I  R 


sup{« 'B' (t )C ' (0,t )z  :  x  €  R°^dT 
‘I 
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(Sufficiency):  Proceeding  by  contradiction,  we  suppose  that  for  all  non-zero 
solutions  z(*)  of  (S'),  we  have 


H  (B'  (T)z(T))df  •  • 

•> 

o  R 

but  the  columns  of  B '  ( •  )<j '  (0,  • )  are  linearly  dependent  on  every  bounded  Interval 
_0,T].  Let  (I  )  .  be  a  monotone  increasing  sequence  of  tines  such  that  T 


Then,  for  each  n,  we  can  find  a  non-zero  vector  "i  such  that  B '  (r  )C 1  (0,r  )“z  ■  0 

n  n 

on  TO.T  l.  Let 
n 


Then,  (z  ,  is  a  sequence  in  the  (compact)  unit  ball.  Hence,  we  can  extract  a 
n  n- 1 

subsequence  z  converging  to  some  2  ,  2  •  1.  We  notice  chat  the  corresponding 

Uj  o  o 

subsequence  of  tines  T  still  converges  to  *.  Furthermore,  for  each  fixed 
t  €  r0,«),  we  have 


B ' (t  )t '  (0,r  )2  ■  lim  B ' (t  )fl  '  (0 ,t  )  z 

°  J  -  -  J 


Consequently,  if  2(t)  is  the  trajectory  mate  of  2^, 


m 

H  (B'  (t  )z(t  )  )dr«  sup[a 'B ' (t  )3 '  (0,r  )z  :  *  €  R  "}dr  •  0 


.  a 
o  R 


which  contradicts  the  assumed  hypothesis 
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APPENDIX  C 


Proof  of  Leona  4.1.  For  (x  ,T)  fixed.  J(x  .T.X)  can  be  expressed  as 
■  ■  o  o 

J(xo,T,\)  -  sup^X)  :  a(-)  6  T. <0)1 

where 

,T 

H  (X)  ■  \'i(T,0)x  +  X  '  5  (T  ,r  )  B  (t  )ui  (t  )  dT  . 

X  Q  • 

O 

Consequently,  J(X0.T»*)  is  the  pointwise  supremum  over  an  indexed  collection  of 

continuous  linear  (hence  convex)  functions.  Hence  J(x  ,T,*)  itself  must  be  con- 

o 

vex  and  at  least  lover  semicontinuous  (in  fact,  continuous).  [ 


Proof  of  Lenina  4.2.  We  prove  this  lemna  using  some  of  the  standard  prop¬ 
erties  of  subdifferentials  given  in  Rockafellar  ^21*,  T22],  Since  both  functions 

in  the  definition  of  J(x  ,T,X)  are  finite  and  convex.X*  €  *J(x  ,T,X)  if  and  only 

o  w  o 

If 


€  i(x^,(T,0)X) 

-  J(T,0)xo 

-  2(T,0)xo 


.T 

*5  Hr.(B'(T)C,(T,T)X)«*r  (by  Theorem  23.8  of  T22]) 

•  u 
o 

.T 

5H-  (B ' (t  )C  '  (T,t  )X  )dt  (by  Theorem  23  of  ^22?) 

%  ft  A 

o 

.  fi(T,T)B(T)'3Hr.(!“(T))'«(T)-B'(T)«,(T,T)Xdr 
o 

(by  Theorem  23.9  of  [2l]) 


Nov,  by  Corollary  23.3.3  of  [2i],  ai  (t  )  €  5R~(£(t))  if  and  only  if 

"  ft  A 

*^(t)  €  arg  max[*'£(T)  :  a  €  .  Substituting  the  required  form  for  £  above,  we 

obtain  our  desired  representation  for  X*. 
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APPENDIX  D 

Sketch  of  a  Proof  of  Theorem  5.1.  Let  f  :  L*(0,T;Rm)  •*  R,  g  :  Rn  -#  R, 

:  L^(0,T;Rm)  Rn  be  given  by 

f(u)  ' »  0  if  u(»)  €  ft  (fl)  ;  f(u)  &  +  m  otherwise  ; 

g(s)  ^  -  ”3(T,0)xo  +  4\  ;  s  €  Rn  ; 

1  PT 

A^u  ■  S  (T,t  )B(t  )u(t  )dT 
‘  o 

Then,  using  the  notation  above 

inf(XN)  ^  tn£C!!x(T)||  :  «(•)  €  5>.(T.)) 

■  inf{f(u)  -g(A^u)  :  u  €  L^(0,T;Rm)l 

Written  In  this  way,  tnf(MN)  is  in  the  standard  fora  for  application  of 
Rockafellar’s  extension  of  Fenchel's  Duality  Theorem  (cf.  [23",  Theorem  1).  The 
functionals  f  and  g  are  respectively  proper  convex  and  concave  functions;  it  can 
be  easily  shown  that  inf(MN)  is  "stably  set"  —  a  technical  precondition  for 
Rockafellar 's  Theorem. 

By  carrying  out  the  computations  involved  in  Theorem  l  of  [23[,  it  can  be 
shown  that  the  problem 

min(MN)*  &  min{j(xo,T,\)  :  X  6  A} 
is  dual  to  lnf(MN)  in  the  following  sense: 

inf(MN)  ♦  minCMN)*  -  0  . 

The  "extremal ity  condition"  in  Rockefeller's  theorem  provides  a  necessary  con- 

* 

ditlon  which  must  be  satisfied  by  all  solution  pairs  solving  (MN)  and  u^(*) 
solving  (?CO.  This  extremallty  condition  requires 


if 

where  is  the  adjoint  of  and  >f(u^)  is  the  subdifferential  of  f  at 
our  choice  of  f,  this  necessary  condition  particularizes  to 


V^®(T,t)B(t)  €  (Normal  cone  of  T.(f.)  at  u#(-)) 


3y  definition  of  the  normal  cone,  we 


We  denote  this  normal  cone  at  u 


u  (r )  achieves  the  supreoum  of  a  'B ' (t  )c  '  (T,r )X 


Equivalently,  we  oust  have 


Proof  of  Theorem  5.2.  aj  in  the  proof  of  Theorem  2.3,  let  A_(xq)  be  the  set 
of  states  which  can  be  attained  from  x  at  time  T.  We  recall  that  this  set  is 


compact  and  convex.  Define  W 


In  accordance  with  Proposition  2.3  of  £19,  p.  171 


point  because  the  following  conditions  are  satisfied 


W(\,*)  is  concave  and  upper  semlcontlnuous 


f)  is  convex  and  lower  semlcontlnuous 


Since  W  (>.,»)  possesses  a  saddle  point,  we  note  that 


Furthermore 
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These  equalities,  in  conjunction  with  the  fact  that  possesses  a  saddle  point, 
imply  that  also  has  a  saddle  point. 

To  prove  the  last  part  of  the  theorem,  we  take  (X*,u^O)  co  be  a  given 
saddle  point  of  VT(\,u(-)).  Hence  we  have 


(D.3) 


*  aln  aax  V  (\,u(-» 

T  xe.  u (•  )€T\  cn) 


Using  a  measurable  selection  argument,  as  in  the  proof  of  Theorem  2.3,  it  is 


also  apparent  that 


(D.4) 


min  max  V  (X,u(*))  ■  min  J(x  ,T,X) 

xe\  u(-)€T.(n>  T  x€a 


From  (D.3)  and  (D.4)  we  conclude  that 


(D.5) 


V,(X*,u#(.)>  -  min  J ( XQ  » T » X ) 


From  Theorem  2.3  and  the  consnents  following  the  theorem,  we  know  that  xq  can 
be  steered  to  zero  at  time  T  if  and  only  if 


0  ■  min  J(x  ,T,X) 
X€A  ° 


■  VT(X^,u^(-))  (by  (D.5)). 

complete  the  proof,  we  must  show  that  if  V  (X#,u#(*)>  ■  0»  Chen  u  (•) 


steers  x  to  0.  Now 
o 


0  -  VT(X*,u#(->)  i  VT(X,u*(-))  for  ail  X  €  A 


r  1 
0  <  X"  t  (T,0)x  ♦  J  (T,r  )B  (t  )u^(r  )dr  for  all  X  €  A 
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Thus 

(D.6)  0  i  X'  x(T,x  ,u  (•))  for  all  X  €  A 

o 

Since  0  Is  an  Interior  point  of  the  convex,  compact  set  A,  (D.6)  implies 

x(T,x  ,u.(’))  •  0  and  u  (•)  is  a  steering  control.  Z 

Q  W  ft 
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CONTROLLING  A  SYSTEM  TO  A  TARGET  -  PART  l : 


LINEAR  SYSTEMS  WITH  ORIGIN  AS  TARGET 


W.  E.  Schmltendorf 
Mechanical  Engineering  Department 
Northwestern  University 
Evanston,  Illinois  60201 


B.  R.  Barmish 

Electrical  Engineering  Department 
The  University  of  Rochester 
Rochester,  New  York  14627 


SUMMARY 

Consider  a  systen  described  by 

x(t)  -  A(t )  x(t)  ♦  B  (t )  u(t),  tc{0,»)  (S) 

where  x(t)«  Rn  is  the  state  and  u(t)t  R®  is  the  control.  The  instantaneous 
control  values  are  required  to  belong  to  a  prescribed  set  P.  in  R™.  M(H) 
will  denote  the  set  of  functions  from  R  into  P.  which  are  measurable  on 
and  u(- )  is  admissible  if  u(')  c  M(f<).  The  tsrget  set  X  Is  the 
origin,  l.e.  X  -  {0}. 

We  say  that  (S>  is  •>  controllable  to  X  from  xq  if  there  exists  an 

admissible  control  which  steers  (S)  from  x  to  X  in  finite  time.  If  (S) 

o 

is  .>  controllable  to  X  from  every  x  <  Rn,  then  we  sav  that  (S)  is 

o 

globally  r,  -  controllable  to  X. 

Necessary  and  sufficient  conditions  are  given  for  global  controlla¬ 
bility  to  {01  as  well  as  a  nacessary  and  sufficient  condition  for  the 
existence  of  an  admissible  control  which  steers  the  system  to  the  origin 
from  a  specified  initial  state. 


The  global  result  does  not  require  zero  to  be  an  interior  point  of  n 
while  the  local  result  only  assumes  compact,  not  that  it  contains  zero. 
Furthermore,  the  controllability  test  involves  a  search  over  the  f lnlte 
dimensional  set  fl  rather  than  the  infinite  dimensional  sat  IT. (Cl).  Results 
on  determining  a  steering  control  are  also  discussed. 

lThe  research  of  this  author  was  supported  by  AFOSR  Grant  No.  76-2923. 
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NONLINEAR  SYSTEMS  WITH  A  GENERAL  TARGET 
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W.  E.  Schmitendorf 
Mechanical  Engineering  Department 
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SUMMARY 

In  this  part,  our  results  are  extended  to  the  class  of  nonlinear 
systems  described  by 

*(t)  -  A(t)  x(t)  +  f(t,u(t)),  t c[0 ,•)  (S') 

We  also  allcw  the  target  X  to  be  any  closed,  convex  set.  A  necessary 
condition  and  a  sufficient  condition  for  T.  controllability  to  X  from  x 

o 

are  given  as  well  as  a  necessary  condition  and  sufficient  condition  for 
global  ^-controllability  to  X. 

Unlike  the  work  of  previous  authors,  we  need  not  assume  uniform 
boundedness  of  Che  state  transition  matrix  £(o,t)  or  symmetricity  and 
positive  Invariance  of  X  with  respect  to  i(o,t).  Also,  the  assumptions 
that  Ocf.  and  f(t,o)  ■  0  are  not  required.  For  systems  where  these 
assumptions  are  satisfied  the  necessary  condition  and  sufficient  condition 
reduce  to  one  condition  and  this  single  condition  Is  equivalent  to  those 
available  In  the  literature.  Furthermore ,  we  exhibit  systems  which  can 
be  deemed  T,  controllable  or  uncontrollable  via  our  results  but  existing 
theorems  cannot  be  used  to  determine  If  the  system  Is  ^-controllable  or 
f>  uncontrol lable . 


The  research  of  this  author  was  supported  by  AFOSR  Grant  No.  76-2923. 


APPEND  DC  D 


analysis  Of  dynamic  SYSHMS 


a  usvl;  cm  :cmtxcu.:mc  a  ccrstsasied  iimai  systzm  to  a  l  in  cab  sigspAa1 


V.  I.  Schaltondorf 
Oepartnenc  of  Y»  ch  an  l  c  a  1  Engineering 
Northwas torn  Cnivarstcy 
Evanston.  11 


I.  t.  larniah 
Department  of  Cloctrteal 
I'nlvara  icy  of  lnchaatar 
Bodies  ter,  MY 


^Mleeerlng 


Aka  tract 

•a  consider  tha  problaa  of  steering  tha  atata  of  a  linear  avataa  to  aa  afflaa  target  when  eha  adaUaikl 
control*  ara  rayuirad  to  sacltfy  magnitude  conatrataca.  A  nsceaaary  *od  sufficient  condition  far  ehn  * 
uutaaca  of  aa  adataatbla  control  watch  a taara  tha  tyataa  to  tha  targnc  froa  a  apaciflnd  initial  caadi. 
tloa  la  prosanced  aa  wall  aa  a  nacaaaarr  condition  and  a  aufflclaat  condition  for  global  control labl Ur* 
to  tha  targtt.  Tha  output  controllability  problaa  and  tba  apacial  eaaa  of  a  point  targac  ara  alaa  du> 
cussed. 


2mooucr:a» 


tx.  coBTtouiAi iiiTY  r* oh  a  raiD  »itui  conoma 


Cooaldar  tha  Uaaar  tyataa 

*(t)  •  A(t)a( t)  •  »(t)o(t)  (S) 

where  tha  atata  >it!<Ba,  tha  control  u  ( • )  <  Ba  aad 
A(<)  aad  >(■)  ara  given  continuous  aatrlcaa  of 
appropriate  l loan* loo.  la  thka  pepar.  tha  problaa 
■  rod  led  ia  that  of  dataraialng  If  there  aalata  aa 
adaiaplble  control  u(-)  which  ataere  tha  aya tea  to 
a  target  I  given  by 

I  •  '’a:  U  •  a)  . 

Mara  1  1a  a  known  pea  matrix  of  rank  p  aid  a  la 
a  given  p  vector.  A  control  u(-)  la  adaiaa_lb2« 
if  «(•)  (  1  ,r.)  wnara  D  ta  a  praapaclflad  connect 
tat  la  I"  and  >C)  denotaa  the  aat  of  fuactlooa 
froa  I  lata  that  are  aaaaurabia  on  't0,o). 

da  cow  define  .‘.•controllability  to  target  I.  with¬ 
out  loot  of  generality,  wa  henceforth  taka  tQ«  9. 

Seflmtlon  l.  Tha  linear  tyataa  S)  la  .‘.-control - 
aalo  to  »  froa  i,  If.  given  tha  initial  condition 
aii)  •  «#>  there  axtata  a  control  »(•><  Vf.)  tuch 
that  tha  solution  «(■)  ef  IS)  aatlaflea  '_x ( T)  •  a 
for  •  oaa  T  <  'O.w).  i.a.  «(T)  I  I.  (S)  la  tlobal  ly 
.‘.-controJ^jjb^o  Jj  I  If  It  la  controllahla  ta  I 
froa  ovary  x,  ■<"*«. 

lx  tana  ive  verb  haa  bean  dona  on.thu  problaa  whan 
tha  target  la  tha  origin  (i.  *  t.a-O);  tea,  far 
aiaa.a  '!•*'.  ProPlsna  with  targets  other  than 
I  •  fO'  have  been  sonaldered  In  't-ll^.  In  'lOl, 

It  la  attune  a  that  the  target  la  cleaad.  convex, 
a  I'aatf. c  aeout  9  and  tatlaflaa  tha  poeltlve 
invartanca  condition 

SfO.v  )t  C  J(9,v  '  )•  for  all  r'bv 

where  s(t,t#)  la  tha  atata  tranaltlen  matrix. 

Mara  ow r  target  It  net  required  to  tatlpfy  thaoa 
aatwaetlona.  Neither  da  wa  need  ta  make  tha 
aatuaetlon  that  :(0,v)  la  walforaly  bounded,  aa  in 
'(.!*.  furthermore.  wa  do  not  require  9  <  .*.  aa  in 
'|-10*.  la  '111.  •  tufflclent  condition  for  eon- 
trollablllty  at  xa  It  glean,  but  global  contrail- 
ability  to  net  conaldorod. 

In  tha  next  taction,  wa  preaent  a  nacaaaary  and 
tufflclent  condition  far  ‘-controllability  ta  I 
frsn  whilo  Sac.  1X1  proaonta  global  .‘.-central l- 
abtllty  ream it*.  Sana  aaacial  caaaa  and  antanaiena 
ara  discussed  In  Saa.  TV.  Sac.  t  contain*  exaae.es 
illustrating  tha  raoulta. 


Our  condition  will  bo  given  la  cant  of  tha  acelar 
function  K;  Is  *  I  >  lf  *  t  dofiand  by 

*(«  .Trf)  •  »‘S‘(T.9)L'*  •  a 'a 

O  9 

•  aap{«'S'(v)*'(?,r)L'a:  •  S  Cldr  .  (1) 

4  0 

lb  thn  toluol,  only  coapact  ‘  will  bo  cowtdered. 
Thl*  guarantaao  that  tha  integrand  U  a  contiauawa 

function  of  v  and  thus  tha  integral  la  (l)  u  wall 
da fined. 


T>  a  or  on  l .  Pleb  an-  aubaet  A  o_f  I*  \Auch  con  talma 
T  aa  an  inttnor  point  ■  Thon  'S)  _u^  ‘-control  laola 
to  I  froa  ix^.tj)  and  an.v  _lf 

nla{  tli^.T*)  «  <  l]  •  9  (J) 

hi  1221  t  « 


Proof  ■  Lot  a«<x0:  be  the  aet  of  ttatee  that  can  be 
attained  from  «9  at  tlaa  T,  l.a., 

r  ft 

A_(x  )•  1  *(T,0)«  *  J (T.r  )l(v  )o(v  )dr  :  »<■)  <  )(Q)| 

a  0  u  0  «  J 

O 

and  da f las 

a  * 

VS1  ’  7  *  *'  T  •  U,  «  « 


Slaca  A.(a  )  la  convex  aod  conpect.  aa  la  l.(aa). 
Initial ‘atata  x,  can  be  ataared  ta  I  at  tlaa  T  if 
and  only  If  point  a  and  tha  aat  S»<*  )  cannot  be 
atrictly  aaparatad  by  a  hyparplana  or.  agulvalantly 
If  and  only  if 

o’a  d  awp  -e’b:  b  (  Sj(«#)‘  W 

for  all  »  f  lp.  Tsing  tha  daflnltloa  at  l^(na),(l) 

aa  li(?.9)«#*  sup^  d'L*  (T.v )S(v  )n(v  )4r  :  «(■)  * 

.  o 'a  a  0  <4> 

A*  a  cenoennence  of  tha  naasarabla  aalactisn  theory 
of  'U'.  »•  can  esaauta  tha  aaptaan  aid  tatagral 
operations  ta  (A)  and  wa  have  that  a  <  l.(*9' 
and  oaly  If 

Sfa^.Ta)  »  0  for  all  •  <  t*  •  *** 


The  research  af  tha  first  aether  wa*  supported  by 
th*  Air  Pore#  3ffU*  of  Sclontlflt  loooare.h  undot 
Sranc  and  that  af  tha  aacand  autber  by  tb# 

O.S.  depdrtaenc  of  tnorgy. 


•SO 


*l»«o  K(i#,T,»)  la  ooaitlvaly  honofonaoua  la  a. 
ThaorM  l  !oUom  41  race ly  (to*  (31 .  Z 

la  £13],  ,  cmiiar  raault  u  obtain  ad  for  tha  as  re 
•oaoral  orooloa  ntun  tha  daacrlbiat  in 

*(t)  •  A(t)Kt)  *  f(u(t),e>  mi  tha  earfat  la  a 
cloaad,  com<  tac.  Iwmr ,  a  4lro«t  ea»  Heat  too 
of  '13 1  to  tha  area  las  ca«ai4oro4  ham  loa4a  eo  a 
alniaiaation  la  (1)  wn  4°  rathar  cfeaa  I*.  Thua 
tha  «aa4lcloa  dariwnd  Sara.  which  aaololti  tha 
afftao  •  cruccura  of  cAo  car«oc.  la  aaator  eo  aaolf. 

UX.  CUUL  CamoLUSlUTT 

lafara  »raa«atia«  oar  |loOal  raaulea,  «a  ia«4  a 
oralialaarr  laaan. 


■  i mi.  A  w«mn  end  mfflclant  condition  for 
iaf(  *’•<:  *<!'>-  •  taae  u  4  4(1')  unoro 
•  d‘)  iaeocaa  eAa  raata  o  <  . 


front.  If  a  €  4(1’),  tAoa  v  •  I'o  for  loao  j  (  l>. 
Coaaa*waocl7,  laf(a'a:  a  f  »)•  lnf(v'lm:  *  (  ») 

•  a’»  »  »  •. 


lame,  cumnoa  lnf(n'w:  1  |  t)  •  |  • 
u  4  4(1').  Than  chart  la  u  a  vector  w 
null  cooca  of  l  cacufytni 

but 
la  tho 

v'w  a  c  4  0 

<») 

lac  •  9 

<T) 

lac  «*y  4,  t.a.  la**  a  and  iafino 

»  •  «*■  a(i*n  e)w.  a-1,2,3,... 

(•) 

fro«  (4)  cad  (?) 

Ui*  * 

(*) 

w’m^a  u’m  •  al «! 

(10) 

Than 

laffu’m:  1  (  4)  <  w’n*-  »1  «| 

<U) 

S Inca  tha  rl4ht  hand  cida  of  (1X3  erode 

eo  -a  U 

a  -  a.  loffa'i:  I  f  ll  •  «  which  la  CAo  contra* 
4|C(lo«  wn  took.  ' 


Our  condition  for  global  .T-concroUeblllrr  will  >o 
tlvan  la  torao  of  two  tlaa  functlooa.  for  *1  f  Is, 
4of  lao 

,  •* 

»r. i)  •  •onfo,»’(r>«,<0.*)1:  •  «  3l4r 

4 

9 

-l»/[«‘ S' (0, t)*;  <  f  4)  (12) 

«(t>  i  aln(V (} ' (t  ,0)l’o ,  t)  '  »  f  l?. 

’1*’(t.0)U>;  -  ll  (U) 

TAoorra  2.  A  mimn  condition  for  tiobal  *• 

12  *  11 

»«0  *(t»*9,t)  •  •  •  (IA) 

t  *  9 

for  «’■  •,  »  I  4*.  a  4  o,  A  luff  (clone  condition  for 

l. 2Ha  "*iaaii»iia»iiin  12  1  i* 

•a*  V(t)  •  •  •  (U) 

t  a  0 

Proof .  Cloetee  icv)  frocoadmi  *»  contradiction, 
i ao ooo 0  *)  i«  (looallf  .“.•cantrallaoio  to  I  Out 
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(14)  la  aoc  aatlaflod.  Than  CAara  unto  a  cons  coat 
0  <  J  <  '1  and  ao  f  i  %? ,  f  e  0,  luch  tAat 

»(lTt)  <  9  for  all  t  a  0  . 

Cooa  aquon  c  l  r , 

taf(*,s‘<0,e)l'7r  i  (  (I  >  ■•  for  all  t  a  0 

cod ,  f ron  tha  lc—e.  tAora  uiaca  at  oacb  cf£0,a), 
a  vac  tor  o((  tfi  ouch  tAat 

t'to.oL?  •  f»e 


Ut, 


Thao 


t(t..eo  )  -  *  ’O'Ce.OH*  -  *'a 

9  C  9  t  t 

ft 

«■  «uo(» (r '0  •  ( t.r  :  a  f  fl}4r 

*  a 

a  >24  -  Inf  [o  t  Ls:  eft) 

fl 

•  euo{n '4 '  (r  1* '  (0,r  )IT:  a  f  OlAr 

*  o 

•  *24  a  »(l7,t)  -  .  g 

lane  a .  C(T,.Cjt)  <  3  for  ill  t  a  0  cad.  fron 
Thaoru  l.  ehli  laoliat  10  aoc  coocrollaOla  to 

4  uAlcA  cantradictf  tha  aiaunotioo  of  (loOal  fi- 
controllability  to  t. 

(Suff lciaocr)  Adam  procoodlaf  ov  contradiction, 
tuaooio  ( 13)  la  tatlaflod  out  eno  m Ea  ic  not 
(loOal >7  .T-eootrollaolo  to  t.  Thao  thoro  uicta  an 
initial  condition  1,  unich  cannot  oa  ettarad  eo  1. 
la  accordance  with  ThaorM  1.  jiric  c»r  tlf®.*). 
than  la  com  aoo-ioro  vector  i ,  cuch  choc 

t’j'fe.O)!’*,,*  a  'a 

9  5  % 

•  curin'*'  (»)8’  (e,T)f»  ■  a  f  T.'dr  <  0  (l*) 

4  » 

9 

(Joint  tho  Schwarts  manual  l  rr.  It  follM*  fTM  (14) 
that 

f 1  , 

cuoin’*’  (»  >9’  (t,r)l'ot  a  <  ")♦ 

-Uf{»*  U:  >(  l|  I  Jt^1  :*’(t.0)l  »t  <l*) 
for  all  mlO.m).  lot 

J  a  -  -  L-, -  (14) 

Old  observe  that  'V(t.0)l3  •  l.  Blvldlnf  <2?> 

*7  "9’ (t,0)L'»p!  end  ue  inf  rfi  fact  that  j'(t,r)  • 
4,(0,»)9'(t,0)  wo  obtain 

at 

iuo{o’4’ (T)9,'0tr)4*(t.01f*  :  »f  "'4r 
•  • 

-Uif(«,3’(0,t)S,(t.9)l3t:  «  <  4%  *  !«a 

for  oil  t  a  0.  Thia  1a  ofulvalont  to 

»(j'(t.0)it{.t)  4 
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(or  «11  I  l  0,  This  lap  Ilea 

«(t)  < 

(ar  all  C  a  9  and  we  Have  contradicted  the  H rpo* 
cheat  a  that  tup  W(tl  •  *  «.  Q 

t  a  o 

If  tha  rtaul u  at  ^13]  (or  nonllaaar  ayatana  and 
lanaral  target  ara  applied  to  (J)  v  ith  target  I.  a 

•  toller  thaaraa  raaulta.  Novever,  It  Involve#  aa 
o-*actor  raoiar  uaa  a  p  vector*.  rurthemora, 
the  n((UlaacT  portion  requirea  that  a  llaaar 
progranaLoi  preplan  be  aalvad  at  aach  t  »  0.  Coa- 

•  epuancly .  that  raault  la  aara  difficult  to  apply 
man  thaaraa  2  ataaa. 

rv.  sptcuL  oasis  and  arntjtoM 


Corollary  '■  A  oacaaaary  condltlaa  tor  c_» 
r.-ecmtrollaetUcy  la  chat  for  all  ja 

tup 

t  »  0W  1 

,T 

*  ]^«up(a,*,(T)»,(0.T)11:  a  «  alj  -  *  . 

(or  ill  ",  «  t“,  S  d  0.  A  lufflcltn 
eoalata  Cl-coocToUabilieu  it  that*1 

tup  ala  •  aup{a'l* (▼  )•' (t,r )a:  a  <  nldr 
t  »  0  w0 

-  *j»s  |j«‘(c,0)L'aj! 


la  thla  taction,  ve  dlacuaa  our  raaulta  (or  aoaa 
apaclal  targeta  and  alaa  thou  hau  cha  raaulta  can 
ha  aataadad  to  ayatana  of  cha  (ora 

A(t)  -  A(c)m( t )  •  l(c)«(c)  ♦  g(t) 

uhara  g(*):  1  «  t1  la  a  contlauoua  (unction.  (Thla 
la  a  apaclal  caaa  at  cha  aara  ganaral  aya tan  i(t)  - 
A(  c)a(c)  *  f(u(t),t)  a  cud  lad  la  fl3].)  Tha  output 
contra l lebtl Icy  prohlan  la  alaa  axaataad. 

r.-aull  Contra Uahll icy-  « tan  Lot  aaad  a-O.  on  ha»n 
I  •  *.01.  than  Kaj.lol,  |l*aa  La  (l),  hacanaa 

.1 

n’dTT.3)*  *  a^n'S*  (rJp'fT.rlPS  a  €  nldr 

•  •  a 


Svataap  tflth  a  forcing  function:  luppeaa  Cha  ryatan 
la  daacrlbad  ay 

i(t)  a  A(t)Xt)  *  l(C)u(C)  ♦  g(t)  ($) 

whara  g(-):  tut*  la  cooclnuaua.  far  VO*,  lac 

i(«  ,?,A>  a't’d.OlL'V  -  a'\ 

O  P 

♦  J ?aup  f[n'l,<»>  *  g'(Y) V(T.r)L*\s  a  <  oil  dr 
‘0  ' 

Thaaraa  l  appllaa  to  tha  aya  tan  <j)  if  un  rap  lac  a 
S(«0.T.i)  by  u  th*  thaaraa.  Tha  proof 

at  thla  raault  la  oaarly  identical  to  tha  proof  at 
Thaaraa  l  and  la  aalttad. 


la  thla  caaa.  Thaaraa  1  tcacaa  that  (S)  la  “-con¬ 
tra  l lab l a  to  tha  origin  Cl- mil  1  controllabla)  at 
a#  l(  and  only  If  tharo  ax  lata  a  T  »  0  and  a  aac  A 
ruch  that  tha  auiaa  value  at  cha  ab«*a  Kfa,,?^) 
mr  all  p  <  A  la  taro.  Thu  U  idaaclcal  to  tha 
raault  la  rurtharaora.  It  caa  ba  ahown  that 

tha  global  raault  of  Thao  ran  2  (or  %  “[O'  U 
equivalent  to  tha  global  raault  at  '13.  (ar  thU 
apaclal  caaa.  riaally.  under  tha  atruagtheaed 
hypothaala  that  Cl  coot  alaa  taro,  tha  aacaaaary 
condltlaa  aad  aufflcleac  condition  of  Thaaraa  2 
aarga  lata  a  a  lag  la  condltlaa  which  la  bach  nacaa* 
a  ary  and  aufflclant  (ar  global  Cl*aull  control  la- 
biliry^ 

aop{n  (» '#'  (0,r  lp:  a-  <  (11*  •  *  “  . 

*0 

and  thla  U  idootlcal  to  tha  global  raault  la  [•«. 


Thaaraa  1 


Tha  global  raault  of  Jhaoroa  2  alaa  appllaa  to 
ayatana  of  tha  (ora  (S)  if  cha  latagrada  U  (12) 
aad  (13)  ara  replaced  by 

tup  «f  ta '  • '  (y  )  *  g'(Y>  V(0.r)f1:  a  «  Cl} 


tup  ^>’»’(y)  •  g(t fl •’ (T,r )l'p:  a  (  flf  . 

raapoctlvaly. 

Output  Coatrollabl  1  try-  Suppaae  that 
*(t)  -  A(t)*(t)  *  l(C)aft)  *  g(t) 
y(t)  •  Oi(t) 

whare  y <  * )  It  tha  output  and  C  U  a  pa  aatrl*  of 
rank  p.  Controlling  tha  output  to  a  (pacified 
pout  y.  (  «*  U  equivalent  to  ataarlng  (S)  to  the 
target  4  •  {■:  C*  -  y.1.  Hence  our  raaulta  apply 
to  tha  output  central  tab lllcy  prohlan  If  «*•  replace 
1.  by  C  la  our  tbara. 

».  OAintl 


Carol larv  1.  yttb  anv  aabaet  A  o£  «*  which  cen- 
■  iiiu  1  an  an  interior  pout.  Pen  (S)  ±t  e^a- 
o lately  C.-contra , lei  .a  i_f  and  only  ^f  r»t  every 
pair  o0.n.«  I*,  were  ^  *  tine 
depend  on  i,  and  a.  tuch  that 

nl*((n  ,T  .»):  *  «  a}  •  0 

“a*  l 

vhare  “a."  replace  "a”  and  >t  *4  lie  definition 

Al  I  «iy4o  ^n  (1). 

A  raault  an  coaplata  r.-eontrellablllty  caa  alaa 
ba  obtained  via  Thaaraa  2  and  la  prea anted  an  a 
aocond  corollary. 


We  praaeat  rua  ecaaalaa.  la  tha  flrat,  ua  ap*lf 
Thaaraa  l  aad  la  tha  aecond.  »e  lavaatlgaca  global 

caa (reliability  via  Thaoran  2. 

toanala  1.  Ceonlder  tha  aya ten 

kx(l)  •  tjd)  •  a(t)  .  *,(»>  •  «j (*) 

Per  every  Cl  (Including  >»),  tha  ayetan  U  aot  con- 
plataly  controllable,  goveeer ,  It  la  atlll  potalhu 
ta  ataat  tha  tyiin  to  a  ana  targata.  lueeoa  a 
■  ,  ’0  i'  and  L  *  fl.Ol.  a  •  l  an  that  tha  target  la 
’•  -  <  *1-  o.  rat  thi.  prohlan 
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•<•*«!„  *  1  *  «T>  .  *  *  0 

."<“i0*T  *  11  •  *  *  0 

mn{K(a#,T,»)  :  a  <  t-l.W  •  3  Lf  md  only  It 

2a‘T-  l  d  *lQ  d  o*T 

Tboro  la  T  t  [0,»)  inch  that  thla  Uaquollcy  U 
tacit  fled  it  at  only  It  -l  <  *l0  a  1.  Thua  wa 
eoac ludo  fron  Tfeooron  1  that  <*iq.*3q)  cm  ha 
icon  rod  to  I  it  md  only  It  -l  <  «,1  *  l  and 
—  <  «io 

*mt  tuaaoaa  4  a  ((aj,*,)  :  *j»  ll .  Then 


C(«a.T.a)  -»(«j0aT.  l) 
yd  « 

ilnftja,.?*)  :  *  «  •  0  If  md  only  If 

o'*.  Thar  a  U  a  T  <  'O.o)  ruch  that  chla 
:lon  la  tacldflad  If  and  aaly  If  0  <  «j0  *  l. 
i,  Cha  tyocan  cat  ha  •  reared  ca  thla  tarmac  If 

•  IjlfatljjtaBiXljjtl. 


►  la  1.  11a  eaaaldar  tha  double  Integrator 

k^(t)  * 


ij(t)  •  n(C> 

tm d  tha  control  conacraiat  »ac  la  CJ  •  '-l.il. 

Suvaoaa  tha  carta c  La  «.•  I  *  »,  i«  that  •  [-l.t! 
md  mi.  For  tbia  pro* * m 

a* 

V(L'».C)  •  wtiafrallt  :  o*'-l.  O* 

*3 

-l»f((-a^»  a, c  •  :  -  V  *2*  11 

*  -l»f((«jt  •  l}n  :  Kjf  «1 

Slaca  lof((a.c  «  l )o  :  M  ll  •  •  far  all  »  F  0, 
ffl'a.t)  a  *  a  tor  all  »  a  0  tad  cha  aacaaaary  con¬ 
dition  far  (lahal  coatrollahlllty  ta  •  la  aatlaflad. 


4e«t,  -a  chaek  tha  •ufflclant  condition. 

y  * 

»(«‘(t.0)U*,t)  •  |n|  :  |r*l-t|*»  -« 

_ fw(«  * r'  - • .  ot  t*  i 

U«l(f"  -i*t;  *  •  .  t  »  i 

mas,  far  Octal. 

H(t)  •  ala  '  '•l(t  •  1“,  •  a  :  a*"  l  •0-0*'  ■  1* 

-[imi-o*]  («*f-  0 

far  t  a  l. 

M(t)  •  ala  ' •  l- 1*  a  :  »*"  l  •<l-t)*"'  •  If 

•[»  J  f  *  *) 


Slaca  ,ll>s  '4(C)  •  *  a,  tha  tufflclenc  condition  la 

aacLaftad  tad  chia  tyacaa  it  globally  "-controllable 

to  *. 
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